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Preface 


Hie rapid devolopmeril of computer engineering in 
recent times has led to an expansion of application of 
mathematics. Quantitative methods have been introduced 
into practically every sphere of human aclivity. The 
use of computers in the economy requires skilled spe- 
cialists who have a command of the methods of computa- 
tional mathematics. 

Computational mathematics is one of the principal 
disciplimv? "•‘cessary for the preparation of specialists 
for various brandies of economy. By studying it students 
acquiri^ theoretical knowledge and practical skill to 
solve various applied problems with the aid of mathemati- 
cal models and nunuuucal methods that ari' realized on a 
compiitc'r. 

This study aid assumes that the reader is aware of the 
elementary concepts of higlier mathematics, i.e. contin- 
uity, th(i derivative and the integral. It covers thn‘e 
large divisions of mathematics: “Algeliraic, Mcdhods'” 
(Ch. “Numerical Methods of Analysis” (Ch, 1, 7, (S) 
and “Numerical Methods of Solving Differential Equa- 
tions” (Ch. 1), 10). 

The theoretical material presented is illuslrated by nu 
meroiis examples. Each chapter is concluded hy exer- 
cises for independent work. 

The following designations are used in the book: the 
signs □ and ■ are used for the beginning and end of the 
proof of an assertion and the signs A and A for the be- 
ginning and end of the solution of a problem. 

We wish to express oiir gratitude to Assistant Professor 
iN. 1. lonkin and L. V. Matveeva who reviewed the manu- 
script and made valuable remarks which thus improved 
the text. 
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Introduction 


Bcforn beginning Llic exposition of the material, we 
shall briefly characterize computational mathematics, 
for which purpose we shall answer the following three 
questions; 

(1) What is computational mathematics? 

(2) W'j.i .:rc the disHnetive features of computational 
Tiiathematics which allow it to he a special division of 
mathematics? 

(2) What is the signilicance of computational mathe- 
juatics for the economy? 

1. The term “computational matheiratics” means now 
a division of mathematics which studies problems con- 
nected with the use of computers. 

We can distinguish three trends in computational 
mathematics. The first trend is connected with the use of 
computers in various fields of research and appli",ations 
and includes, in particular, numerical nulutiori oi • rious 
mathematical problems. The second trend is con .ected 
with the elaboration of new numerical methods and algo- 
rithms and perfecting the old ones. The third trend is 
connected with the problems of the interaction of man 
and computer. 

This hook is devoted to the first trend, namely, the use 
of numerical methods when solving applied problems. 

The foundation on which computational mathematics 
is constructed is composed of various computing faci- 
lities, computers first of all, whose rapid development is 
the most characteristic feature of the technologic al 
prcjgress today. Thus, during the la. thirty years, the 
speed of computation increased from one operation per 
second (with the use of a slide rule) to 3 000 000 opera- 
tions per second, i.e, 3-10® times. It is appropriate to 
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recall that from the time when a steam engine was in- 
vented the speed of travel increased from 13 km per hour 
(the speed of a horse) to 40 000 km per hour (the speed 
of a cosmic vehicle), i.e. only 3-10® times. 

2. We can use the following examples to illustrate the 
characteristic features of computational mathematics 
which distinguish it from pure mathematics. 

From the point of view of a “pure” mathematician, to 
solve a problem is to prove the existence of its solution 
and show a process which leads to a solution. For a pro- 
grammer, the time of obtaining a solution, i.e. the rate 
of convergence of the process, is often a more important 
factor. Thus, it is knowm that a solution of n simultaneous 
algebraic equations can be theoretically obtained for 
any specified n as a result of a finite number of operations, 
say, with the aid of the method of Cramer or Gauss. 
Therefore, from the viewpoint of a “pure” matlicrnatician, 
a problem of this kind is considered to be solved. Howe- 
ver, when these methods are used in practical applica- 
tions, two difficulties, which can not always bo overcome, 
are often encountered. The first difficulty is that for a 
sufliciently large n the number of operations, although 
finite, is so large that it is impossible to carry out all 
of them even with the use of the most powerful computers. 
Thus, to Isolve a system of n equations by Cramer’s 
method, we must perform n-n\ operations, and this consti- 
tutes 4.6-10^*^ operations for n = 20. Then, with the rale 
of 3 ‘10® operations per second a computer must operate 
continuously for half a million years. Gauss’ method 
proves to be more efficient. With the use of this method, 
the number of operations needed to solve the same prob- 
lem is of the order of 

However, such a large number of operations generates 
a second principal difficulty: the errors resulting from all 
operations accumulate and exert such a great influence 
on the final result that it often becomes far distant from 
the true solution. 

Nowadays exact methods are usually used for solving 
systems of equations when their order is not higher than 
10^. Therefore, from the point of view of a programmer, 
the problem of solving a system whose order is higher 
than 10^ is not at all trivial. To solve such a system, ite- 
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i'ative methods are used wliich are approximate but pos- 
sess a significant advantage of not accumulating compu- 
tational errors from iteration to iteration. Thus we deal 
with a seemingly paradoxical situation, but one that is 
typical of numerical methods, namely, that approximate 
algorithms are preferred to exact ones. 

3. The essential expansion of the fields of application 
of computational mathematics, including its inculcation 
into economy, can be explained by the fact that natural 
phenomena and the phenomena of social life, different 
in their sense, are often similar in formal structure and 
can, consequently, be described by the same mathemati- 
cal models. We can therefore use the same numerical 
methods to solve the problems described by these models. 

Gomp./^rc! are principal factors making for the acce- 
leration of the scientific and technical xnogress, for the 
realization of the complex and purposeful programs of 
solution of the most important scientific and technological 
problems and for tlie further increase in the productivity 
of labour. Tlie development of comp^’ters and computa- 
tional mathematics will make it possible, for instance, 
to pass from the automatization of the control of techno- 
logical systems and processes to the automatization of 
the control of production processes. 



Chapter 1 

Elementary Theory of Errors 


1.1. Exact and Approximate Numbers. Sources and 
Classification of Errors 

In the process of solving a problem, we have to deal 
with various numbers which may be exact or approxi- 
mate. Exact numbers give a true value of a number and 
approximate numbers give a value close to the true one, 
the degree of closeness being dependenl on the error of 
calculation. 

For example, in the assertions “a cube has six faces”, 
“we have live lingers to a band”, “there are 152 students in 
a class”, “there are 582 pages in a book” the numbers 
6, 5, 32 and 582 are exact ones. In the assertions “the 
bouse is 14.25 m wide”, “the radius of the Earth is 
()00() km”, “the mass of a match box is ten g” the numbers 
14.25, 6000 and 10 are approximate. 

This isdue, first of all, to the imperfectioii of measuring 
instruments we use. There are no absolutely exact mea- 
suring instrumeiits, each of them has its own accuracy, 
i.e. admits of a certain error of measurements. In addition, 
in the second example the approximation of a num- 
ber is in the very concept of the radius of the Earth. The 
matter is that, strictly speaking, the Earth is not a sphere 
and we can speak of its radius only in approximate terms. 
In the next example, the approximation of the number is 
also defined by the fact that different boxes may have 
different masses and the number 10 defines the mass of a 
certain box. 

In other cases, the same number may be exact as well 
as aj. proximate. Thus, for instance, the number 3 is exact 
if we speak of the number of sides of a triangle and approx- 
imate if we use it instead of the number ji when calculat- 
ing the area of a circle using the formula S = 

In practical calculations, we understand the approxi- 
mate number a to be a number which differs but slightly 
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from the exact number A and can be substituted for it 
in calculations. 

The solution of the majority of practical problems 
with a certain degree of conventionality can be represent- 
ed as two successive stages: (1) the mathematical descrip- 
tion of the problem on hand, (2) the solution of the for- 
mulated mathematical problem. 

At the first stage, wo may encounter two characteristic 
sources of errors. First, the fact that the processes hap- 
pening in reality can not always be described by means 
of mathematics and the simplifications we introduce make 
it possible to obtain onlymore or less idealized models. 
Second, the initial parameters are, as a rule, inexact since 
they are obtained from an experiment which gives only 
an approirnate result. 

Accordingly, the total error of a mathematical model 
and initial data is considered to be the error of the initial 
information. Having in mind that this error is independent 
of the second stage of solving the problem, we often call 
it a nonremovable error. 

It is, as a rule, unrealizable in practice to obtain an 
exact solution of a mathematical problem (the second 
stage) irrespective of whether it is constructed analytically 
or on a computer. Thus, for instance, we can obtain an 
exact solution for only a very restricted class of differen- 
tial equations. Therefore, in practical calculations, ve usu- 
ally use the methods of approximation of so ^tions, 
numerical first of all. 

Such a compulsory replacement of an exacl solution 
by an approximate one generates an error of the method 
or, as it is often called, an error of approximation. 

Finally, in the process of problem solving, we round 
oft the initial data as well as the intermediate and final 
results. These errors and the errors arising in the arithme- 
tic operations involving approximate numbers affect, 
more or less, the result of calculations and form a so- 
called rounding error. 

In this connection, when we foro late a problem, we 
either indicate the accuracy of the solution required, i.e. 
specify the maximum error permissible in all calcula- 
tions, or only calculate the total error of the result. There- 
fore, when dealing with approximate numbers, it is 
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necessary to know how to solve the following problems: 

(1) to characterize the exactness of approximate num- 
bers by mathematical means, 

(2) to estimate the degree of accuracy of the result 
when we know the degree of accuracy of the initial data, 

(3) to choose initial data with the degree of accuracy 
which will ensure the specified accuracy of the result, 

(4) to construct an optimal computing process in order 
to obviate the calculations which do not affect the valid 
digits of the result. 

1.2. Decimal Notation and Rounding off Numbers 

Every decimal positive number a can be represented as 
a finite or infinite decimal fraction 

= ai 40"* -f aa 40*"-i + . . . + + ..., (1) 

where are the digits constituting the number (i = 1, 
2, . . w, . . .) with aj 0, and m is the top digit in 
the number a. 

Example 1. Vlepresent the number 1905.0778 in form (1): 

1905' 0778 = 1403 + 9402 + 040^ + 540‘> + 040-i 

+ 740-2 + 7.10-3 + 840-4. 

Every unit in the corresponding ith decimal position, 
reckoning from left to right, has its value known 

as the value of the decimal position. Thus the value of the 
first (from the left) decimal position is 10"*, that of the 
second is 10"*“^ and so on. 

In the example considered, the value of the decimal position 
containing the digit 9 is lO^-^^^ = 100, of that containing the digit 
5 is 103-4+1 = of that containing the digit 8 is 103-*+i = 0.0001^ 

In practical calculations we often have to round off a 
number, i.e. to replace it by another number consisting 
of a smaller number of digits. In that case we retain one 
or several digits, reckoning from left to rights and discard 
all the others. 

The following rules of rounding off are most often used. 

1°. If the discarded digits constitute a number which is 
larger than half the unit in the last decimal place that re- 
mains^ then the last digit that is left is strengthened {in- 
creased by unity). 
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Now if the discarded digits constitute a number which is 
smaller than half the unit in the last decimal place that re- 
mains, then the digits that remain do not change. 

2°. If the discarded digits constitute a number which is 
equal to half the unit in the last decimal place that remains, 
then Ihe last digit that is left is strengthened, if it is odd, 
and IS unchanged if it is even. 

This rule is often called a rule of an even digit. 

Example 2. Round off the following numbers: = 12.7852, 

= 394.261, ^3 = 6.265001, A^ = 147.5, A^ = 148.5 to three 
digits. 

A In accordance with item 1° of the rules of rounding off, 
we get = 12.8, aa = 394, -- 6.27 since 0.0852 >■ 0.5 • 10“^, 

0.261 < 0.5-10, 0.005001 > 0.5-10-2. 

In accordance with item 2^ of the rules of rounding off, we get 
fl 4 = 148,05 = 148 since the digit 7 is odd and the digit 8 is even. ^ 

In som. 'iflps which are more and more often encountered 
nowadays, use is made of a more simple rule of rounding off. This 
rule consists in a simple discarding of all digits beginning with 
a certain decimal place. Using this rule, we would get the following 
values when rounding off the numbers from the examples consid- 
ered: = 12.7, Oa — 394, a, -= 6.26, = 147, Og = 148. 

1.3. Absolute and Relative Errors 

Let A bo an exact number and a, its approximate val- 
ue. If a <; A, then we say that the number a is an approx- 
imate value of the number A by defect and if a > A, 
Lbeii it is an approximate value of A hi/ excess. 

The difference between the exact number A id its 
approximation a is an error. 

As a rule, it is impossible to determijie the value of the 
error A — a and even its sign since I be exact number A 
is unknown. Therefore vve use the upper bound of the ab- 
solute value of the error rather than the error itself. 

The absolute error of the approximate number a is a 
quantity which satisfies the inequality 

A,> M - a |. (1) 

The absolute error is the upper bound of the deviation 
of the exact number A from its approximation: 

a - A„< + A^. (2) 

Inequality (2) is often written in the form 
A = a -Ai A^. 


2-0104 


(3) 
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The number taken as an absolute error must be as 
small as possible. For instance, measuring the length of a 
line segment, we have found that the error of measure- 
ment does not exceed 0.5 cm, all the more so it does not 
exceed 1, 2 and 3 cm. Each of these numbers can be ta- 
ken as the absolute error. However, we must take the 
smallest of these numbers as the absolute error since the 
smaller the absolute error, the narrower the interval 
within which we specify the exact number. 

In practical calculations we often use expressions 
“with an accuracy to 0.01”, “with an accuracy to 1 cm” 
etc. This means that the absolute error is equal to 0.01, 
1 cm etc. respectively. 

Example 1 . We have measured the length of the lino segment L 
with an accuracy to 0.05 cm and obtained I = 18.4 cm. The absolute 
error here A/ = 0.05 cm. In accordance with formula (3), we must 
write L = 18.4 ± 0.05 cm. According to formula (2), the exact 
value of the length of the segment is within the interval 18.35 ^ 
L < 18.45. 

Example 2. We have measured the length of the line segment L 
using a ruler with the value of the division 0.1 cm. We have found 
that the exact value of L is between 4.6 and 4.7. In this case, we must 
take I = 4.65, i.e. the middle of the interval within which the 
exact number L is, as the approximate value. The absolute error is, 
evidently, half the value of the division of the ruler, i.e. A 2 = 0.05. 
Thus L =*4.65 db 0.05 cm. 

The absolute error reflects only the quantitative aspect 
of the error but not the qualitative one,, i.e. does not show 
whether the measurement and calculation were accurate. 
Indeed, assume that measuring the length and the width 
of the top of a table with a ruler the value of whose divi- 
sion is 1 cm, we have got the following results (in cm): 
the width = 2 ± 0.5 and the length = 100 ± 
0.5. In both measurements the absolute error is the 
same and constitutes 0.5 cm. It is evident, however, that 
the second measurement was more accurate than the first. 
To estimate the quality of calculations or measurements, 
the except of a relative error is introduced. 

The relative error of the approximate number a is the 
quantity 6a which satisfies the inequality 

fia>| ‘^7” I* 



Ch. 1. Elementary Theory of Errors 


19 


In particular, we can accept 

(5) 

as the relative error. and represent relation (3) in the form 
A ^a{i ± 6„). (6) 

Note that a relative error is an abstract number and 
is often expressed in per cent. 

Now we return to the measurements of the length and the width 
of the top of the table and hnd their relative errors: 

= 0.5/2 = 0.25 or 25%, = 0.5/100 = 0.005 or 0.5% . 

In such cases we say that the measurement of the length of the 
top of the table has been relatively more accurate (50 times as accu> 
rate) than luai of its ^Idth. 

Example 3. An exact number A is in the interval [23.07, 23.101. 
Find its approximate value, the absolute and the relative error. 

A We assume the middle of the given interval to be its approx- 
imate value: a = 23.085. The absolute error is half its length: 
Afl = 0.015. Wo assume 6^ = A^/a = 0.000604 ... to be the rela- 
tive error. It is customary to round off the value of the error to 
one or two nonzero dibits. Therefore we can set 6 = 0.07%. Note 
that in problems of tnis kind the error is usually rounded off to 
a larger numW in order that inequalities (2) and (4) should be 
satisfied. ^ 

Example 4. Determine, in per cent, the relative error of the 
approximate number a = 35.148 if 4 = 35.148 ± 0.00074. 

A Using formula (5), we have 

6^ ^ Aja = 0.00074/35.148 ==; « 0.003%. ^ 

Example 5. Determine the absotalipb. of the approximate 

number a — 4.123 if 6^ = 0.01%^^ 

A We write the percentage in Of a decimal fraction 

and use formula (5) to find the ebsoKlti^ error. Then we have 

Aa = I « l -fia == 4.12S•Q^(»?01 » 0.0005, 

4 - 4,123 ± Q.Om- 4 

Example 6. Find out in whiob qi tlte two following onaos the 
quality of calculations is hlghw 4i 13/19 ^ 0.684 or As = 
7.21. 

A To find the absolute errOfa» we tske numbers and jAith 
a larger number of deciipal 3^ 0.68421, y52s 

7.2111 .... We determine the errors by rounding them 

off to a larger number: 

A„^ -= I 0.68421 ... - Q.W4 | s 0.00022, 


2 * 
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= I 7.2111. . . — 7.21 I ^ 0.0012. 

We set»k the relative errors: 

6^^ = Ao^/| flj I = 0.00022/0.684 ^ 0.00033 ^ 0.04%, 

6^^ = A^^/l I = 0.0012/7.21^ 0.00017 ^ 0.02%. 

In the second case the quality of calculation proved to be higher 
since 6^^ < A 


1.4. Valid Significant Digits 


When we solve a problem, we often stipulate that the 
result must be obtained with an accuracy of 0.1, 0.01 etc. 
It may seem that the accuracy of calculations is defined 
by the number of digits after the decimal point. This is 
not so, however. The accuracy of calculations is defined by 
the number of digits in the result which enjoy confidence. 

The significant digits of a number are all its digits, ex- 
cept for zeros, which appear to the left of the first non- 
zero digit. 

Zeros at the end of a number are always significant di- 
gits (otherwise they are not written). 

Example !. The numbers 0.001604 and 30.500 have 4 and 5 
significant digits respectively. 

There are certain subtle points in the representation of 
integers. 'Thus, for instance, if we want to show that the 
last three zeros in the number 400 000 are not significant, 
we must write this number as two factors: 400-10^, or 
40.0*10^, or 0.400-10'^. The last form of the notation is 
known as normalized and is preferable. In this case we 
say that 400 is the mantissa of the number and G is its 
order. 

Recall that every positive decimal number, exact as 
well as approximate, can be repre.sented as 

a--ai.l0’"-fa2.10"*-*+ . . . + an- -|- . . . 


The digit a„ of the approximate number a is a valid 
significant digit (or simply a valid digit) if there holds an 
inequality 

fJA — ( 1 ) 

i.e. if the J^^Uite value of^Sit' difference of tlie exarl 
number awaits approximate does not exceed half 
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the unit of the decimal digit in which appears. 

Since instead of \ A — a \ we usually consider the 
absolute error we often replace inequality (1) by 
an inequality 

A«< 0.5.10^-^+^ ( 2 ) 

because when this inequality is satisfied, the initial ine- 
quality (1) is satisfied too. 

On the other hand, if the number ii of valid digits of 
the approximate number a is specified, then we can take 

A,, = (3) 

as the absolute error. 

If inequality ( 2 ) is not satisfied, then the digit 
is said to he doubtful, it is evident that if the digit 
is valid, tlieii all the preceding digits, to the left of it, 
are also valid. 

Example 2. Wo havo obtained the number a = 23.10 by round- 
ing off an exact D'unber. IIow many valid digits are there in the 
number a? 

A When a number is rounded off according to the rule of an 
oven digit, the absolute error cannot exceed half the unit in the 
fast decimal place that remains. This means that all the remaining 
digits in the rounded-off number are valid. In this case, evidently, 
all the four digits are valid and the error — 0.005. 

Example 3. The number a — 23.071937 contains five valid 
digits. Find its absolute error. 

A We use formula (3). Here m -- 1, n ~ and so we u take 
0.5-10^"®+i ^ 0.0005 as the absolute error. 4 

Example 4. The absolute error of the number a — 705,1978 
is Ap = 0.3. Find out which of the digits of the number a are 
valia and round off the number a leaving only valid digits. 

A We use formula (2). Here m ~ 2, A^ = 3.3 and n must be 
found from the inequality 0.3 0.5-10®"’^q A direct verification 

shows that the greatest n which satisfies this inequality is equal 
to 3 and the digit 5 is valid: 0.3 < O.S-lO^-^+i, and the digit 1 
is doubtful: 0.3 > 0.5- 

Consequently, the number a 705.1978 has three valid digits. 
We round it off to three digits: — 705. Then the total error is 

equal to the sum of the initial error and the rounding error: A^ - - 
0.3 -\~ 0.2 ™ 0.5, and so we can write A “ 705 it 0.5 4 

In maihcMnalical tables all signilici .1 digits are valid, 
as a rule, dduis in the well-known tables of logarithms 
the values of the sine are given willi an absolute error of 
0 .5*10-^. 
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In recent years, the concept of valid significant digits is more 
and more often used in the broad sense. This concept is connected 
with the simplest rule of rounding off which wc mentioned in 1.2. 

The digit of the approximate number 

a = ai • 10^ + aa • + . . . + a „ • lom-n+i _ 

is a valid significant digit in the broad sense if there holds an ine- 
quality 

Aa (4) 

i.o. if the absolute error of the number a does not exceed the unit 
of the decimal place in which appears. 

1.5. The Connection Between the Number of Valid Digits 
and the Error of the Number 


As follows from the definition of a valid significant 
digit, the number of the valid digits of an approximate 
number is defined by the inequality 

1 ^ _ ( 1 ) 

Dividing both sides of inequality (1) by | a |, we 
get 

A~a 0.5-lOm-n+i 

a ^ I ai • 10"» + aa • 1‘ -f . . . + a;, • H . . . | 

^ _ 0.5 

• ^ ai-lO^ ' 


Thus, if the digit a„ of the approximate number a is 
valid, then we can assume 

( 3 ) 

to be the relative error. 

On the other hand, for the digit of the approximate 
number a to be valid, it is necessary that the inequality 

hold true since in this case inequalities (2) and (1) arc sa- 
tisfied. 

When we mean valid significant digits in the broad sense, wc 
can get a .similar formula 
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Example 1 . What is the relative error of the approximate number 
a = 4.176 if all its digits are valid? 

A Since all the four digits of the number 4.176 are valid, 
wo use formula (3) to find the relative error: 


0.5 1 

“ arlO^-i “ 2.4*103 


0.00013 =-0.013%. 


Note that the relative error of the number a can be found from 
the formula 6^ = ^J\ a |. Since in the given number a all digits 
are valid, we have = 0.0005. Then 

= 0.0005/4.176 ^ 0.00012 = 0.012%. 


We can see that the difference is not large, but applying for- 
mula (3), we somewhat simplify the calculations. ^ 

Example 2. What is the relative error of the number a — 14.278 
if all its digits are valid in the broad sense? 

A Since all the five digits of the number are valid in the broad 
sense, we can use formula (5) to obtain 




M0« 


= 0.0001 = 0.01%. A 


Example 3. How many decimal digits must be taken in the 
number V^18 for lhe_error not to exceed 0.1%? 

A Here A -- /iS ^ 4, . . .; 6^ < 0.1?4, i.e. 6o < 0.001. 
1 

We have = 2*4^10 ^ ^^ ^ 0.001, whence 125 < 10*^“^; 1.25 X 

102<10”-i; log 1.25 + 2 < n — 1; n > 3 log 1.25, i.e. 

w > 4. 4 


1.6. The Errors of a Sum and a Difference 

Consider the exact numbers Ai, ylg, . . A ^ and their 

n 

approximations Let ^4 = 2 iLe 

i=l 

n 

sum of all exact numbers and a = 2 iLe sum of 

1=1 

their approximations. We pose the following problem: 
being given the absolute errors . . ., Aa^ 

of all approximate numbers, evaluate the absolute error 
of their sum a. We set up a difference 

A — a = {Ai — a^) + {A^ — a^) + Mn — «n)* 

Passing to the absolute values on the right-hand and 
lQft-h?ind sides of the relation and using the property of 
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absolute values, we obtain 

\ A — I ^ I Aj^ — I + I A 2 — ^^2 I 
... -j- I 71 Uji I . 

Consequently, 

\A -a\^\ + + . . . + A„^ (1) 

and we can take the sum ol the absolute errors of the 
lerms 

Aa = Ao, 4“ Afl, + . . . -4" (2) 

as the absolute error of the approximate number a, i.e. 
the sum of the approximate numbers a,, ag, . . ., a^. 

It follows from the last formula that the absolute error 
of the algebraic sum must, in general, bo not smaller 
than the absolute error of the least exact term. There- 
fore, to obviate excess calculations, wo should not leave 
unnecessary digits in the more exact terms cither. 

When adding up numbers of different absolute accura- 
cy, we usually do the following: 

(1) isolate a number (or numbers) of the least accuracy 
(i.e. a number which has the greatest absolute error), 

(2) round off more exact numbers so as to retain in them 
one digit more than in the isolated number (i.e. retain 
one reserve digit), 

(3) perform addition taking into account all the re- 
tained digits, 

(4) round off the result obtained by discarding one digit. 
Remark. When the number of terms is large {n > 10), 

the evaluation of the error of the sum by formula (2) 
proves to be too high since a partial compensation of the 
errors of different signs usually occurs. If all the terms 
are rounded off to the mth decimal place, i.e. their errors 
are evaluated by the quantity 0.5 *10"^, then the sta- 
tistical evaluation of the absolute error of the sum can be 
found from the following formula: 

A„ = yn-O.S-lO-"*. (3) 

Example 1. Add up the approximate numbers a = 0.1732 + 
17.45 -f 0.000333 H- 204.4 -f 7.25 H- 144.2 + 0.0112 -|- 0.034 -f 
0.0771 in each of which all the written digits are valid. 

A We choose the least exact numbers (those possessing the 
greatest absolute error). There are two numbers of this kind, 204.4 
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and 144.2. The error of each of them is 0.05. We round off the other 
numbers, leaving one (reserve) sign more, and add up all the num- 
bers: 

0.17 
17.45 
0.00 
204.4 
+ 7.25 

144.2 
0.01 
0.63 
0.08 

374.19 

We round off the sum obtained discarding one digit: 374.2. 

We estimate the accuracy of the result. The absolute error of 
the sum consists of two terms: 

(1) the Initial error, i.e. the sum of the errors of the least exact 
numbers a^''’ the roundintJ' errors of the other numbers: 0.05-2 + 
0.005-7 ^ 0.14, 

(2) the error of the rounding off the result: 0.01. 

Thus the absolute error of the sum is 0.15 and we must write 
the result in the form A -- 374.2 i 0.15. Another form of notation, 
A ■-= 374.2 ±0.2 is also possible. A 

Wc do Ihe .sj.iiic in the ease wUcMi one or several approx- 
imate iniml)ers are negative. 

Example 2. Find the difference of the approximate numbers a ~ 
rti — flj evaluate the absolute and the relative error of the 
result if A^ = 17.5 ± 0.02 and A.^ 45.6 ± 0.03. 

A Wc find that a - a^ — 17.5 — 45.6 = —28 1: — 

find the relative error: — 0.05/| —28.1 | ^ 0.002 — G 

We can show that if the absolute error of tlie sum of 
approximate numbers can be found from formula (2) 
and the relative error of the sum ^ | a | , then 

^ ^ma\* 

Example 3. Evaluate the relative error of the sum of the num- 
bers in Example 1 and compare it to the relative errors of the terms. 

A We find th<» relative error of the sura: 

= 0.2/374.2 = 0.0006 -= 0.06%. 

The relative errors of the terms are 

= 0.005/0.17 -- 3%, 0.005, 7.45 - 0.03%, 

- 0.05/204.4 - 0.03%, “6^, = 0.005/7.25 = 0.07%, 

- 0.05/144.2 - 0.04%, - 0.005/0.01 = 50%, 

6^’ = 0.005/0,63 = 0.8%, - 0.005/0,08 = 7%. 
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Thus 6 niln = 0.03%, 6niax=50%, 6 ^ = 0.06%, i.e. the 
relative error of the sum is between the least and the greatest rela- 
tive error of the terms. ^ 

Note that when subtraction concerns close numbers, a 
situation may occur which is known as a loss of accuracy. 
Let X > 0, y > 0 and a = x — y. Then 

« Afl _ ^x + ^y 

Oa - ,^| - |^_y| . 


Thus if the numbers x and y differ but little from each 
other, then even for small errors and A^, the value 
of the relative error of the difference may turn to be con- 
siderable. 


Example *4. Let x = 5.125, y = 5.135. Here A^^ = 0.0005, 
Ajj = 0.0005, 6 ^. ^ ^ 0.01%. The relative error of the difference 


y IS 




Evidently, when subtraction concerns two close num- 
bers, a considerable loss of accuracy may occur. To 
obviate this, wc must change the subtraction procedure 
so that small differences of the quantities arc calculated 
directly. 

Example 5. Find the difierence A = 1/^6.27 — 1^6.26 and eva- 
luate the relative error of the result. 

A Let Ai = /O? s 2.504, Aoj = 0.0005, i4,= /6.26 s 
2.502, Aaj = 0.0005. Then a = 2.504 — 2.502 = 0.2.10-*, A, = 
0.0005 -1- 0.0005 = 0.001, whence 


6a = 


0 . 1 . 10 -* 
0 . 2 . 10 -* 


= 0.5 = 50%. 


However, changing the scheme of calculation, we can get a bet- 
ter evaluation of the relative error: 


yl=V''6.27— /6.26= 


6.27-6.26 

/Ot-i-VOe 


( 1/^06) ( t^07-h /Oe) 
VO? -1-/06 
0.01 


V 6.27-1-/6.26 


0.2.10-* = fl, 


6a = at 0.2 . 10-» = 0.02% . 

ai+«2 5 

Thus, when calculating and a, with the same four valid digits, 
we have got an essentially better result in the sense of a relative 
error. 4 
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Example 6. Calculate the value of the function y = 1 — cos j; 
for the following values of the argument: (1) xi = 80°, (2) ig = 1°- 
Calculate the absolute and the relative error of the result. 

A (1) From the four-digit logarithmic tables we find that 
cos 80° ^ 0.1736 and, since all the digits of this number are valid, 
we have Ao.i^rse = 0.00005. Then yi = 1 — 0.1736 = 0.8264 and 
= 0.00005 (from an exact number equal to unity we subtract 
an approximate number with an absolute error not exceeding 
0.00005). Consequently, 

= 0.00005/0.8264 = 0.00006 = 0.006%. 

(2) We have cos 1° ^ 0.9998, = 0.00005, ya = ^ “ 

0.9998 = 0.0002, = 0.00005, hence 

6^2 = 0.00005/0.0002 = 0.25 = 25%. 

Wc can see from the examples presented that for small values 
of the argument a direct calculation by the formula y = 1 — cos x 
yields a relative error of the order of 25% . For x = 80° the relative 
error is only 0.006%. 

We change the calculation procedure and use a formula y = 

1 — cos a; = 2 sin* (x/2) to calculate the values of the function 
y =: i ^ cos X for small values of the argument. We designate 
a -= sin 0°30' ^ 0.0087. Then A^ = 0.00005, = 0.5/87 = 

0 . 58 % . Furthermore, 

y, = 2.0.0087* - 0.000151, 

Sya 2.0.0058 -- 1.2% 

(see 1.7 below). The final result is 

== = 0.000151.0.012 = 0.000002 

(whereas earlier we had Ayg = 0.00005). Thus a simple transfor- 
mation of the computing formula has allowed us to get a more 
accurate result from the same initial data. ^ 

It is not always possible, however, to transform the 
computing procedure. Therefore, when close numbers are 
subtracted, they must be taken with a sufficient number 
of reserve valid digits (when it is possibbe). If it is known 
that the first m significant digits may be lost and we must 
get a result with n valid significant digits, we must take 
the initial data with rn + n valid significant digit- as 
was done in Example 5. 

1.7. The Error of a Product. The Number of 
Valid Digits in a Product 

The error of a product. Let us consider two exact num- 
bers A I and an d their approximate values and ag. 
Let A = ^xA^ and a == a^a^. We pose the following 
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problem: being given relative errors 6aj and 6^,, evalu- 
ate the relative error of the product 6^,. 

We represent the exact values and A 2 in the lorm 

-4i = fli + Ai, A 2 = ^2 + (1) 

where the unknowns and A 2 satisfy tlfe ijiequalities 

1 A, K l«i 16.,, 1 A 2 |< 1^2 I 6... (2) 

MtUiplying the right-hand and left-hand sides of rela- 
tions (1), we obtain 

~ ^‘1^1 1' A 1 A 2 . 

Passing to absolute values on the right-hand and left- 
hand sides of this relation and using the properties of 
absolute values, we find that 

I ^1-^2 — ^ 1^2 1^ I ^2^^! I I Aia2 I H” I A^Ao I . (d) 

Since the l-ast term on the right-hand side is small, we 
discard it and divide the right-harul and left-hand sides 
of the inequality by | a | = | ajag | . Then, taking rela- 
tion (2) into account, we obtain 

<6ai + 6a2. (4) 

It follows from the relation obtained that we can take 
the sum of the relative errors of the factors 

6a • ' 6a, 4 6a a (f>) 

as the relative error of the product a — 

Inequality (5) can be easily extended to the product of 
several factors so that if A “ ^^^4 2 • • - An and a = 
aia 2 ... fl/, , then we can assume that 

6a ^ 6ai + 602 + • • • + 6a^. (h) 

In the case when all factors, except for one, are exact 
numbers, it follows from formula (6) that the relative 
error of tl^e product coincides with the relative error of 
the approximate factor. Thus, when only the value of the 
factor Ui is an approximate number, then 



A — a 
a 




( 7 ) 
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Remark. When the approximate number a is multiplied 
by the exact factor k, the relative error of the product 
is equal to tlie relative error of the approximate number 
a and the absolute error is | /c 1 limes as large as the ab- 
solute error of the approximate number. 

Indeed, let a = /cAj, where k is an exact factor differ- 
ent from zero. Then, according to formula (7), we have 

1«| |«| 6a,- |A:a,| "1^=- 1*1 Aa„ 

i.e. 

A„ = I ^ I Aa.. (8) 

Knowing the relative error 6^ of the product a, we can 
find its absolute error using the formula = j a | 

If the relative error of the product of approximate num- 
bers can ho found from formula (6), then, when multiply- 
ing numbers with different relative errors, we may not 
retain the extra digits in the numbers with the smaller 
relative errors. We usually do the following: 

(1) isolate a number with the least number of valid di- 
gits, 

(2) round off the remaining factors so that they would 
contain one significant digit more than there are valid 
significant digits in the isolated number, 

(3) retain as many significant digits in the product as 
there are valid significant digits in the least exact. lactor 
(the isolated number). 

Example 1. Find the product of the approximate numbers 
xi ~= 3.6 and = 84.489 all of whose digits are valid. 

A In the first number there are two valid significant digits 
and in the second there are five. Therefore we round off the second 
number to three significant digits. After rounding-off we have 
Xi ~ 3.6, X 2 = 84.5. Hence 

xjxa = 3.6-84.5 = 304.20 ^ 3.0-102. 

There are two significant digits in the result, i.e. as many as 
there were significant digits in the factor with the least number 
of valid significant digits. ^ 

Example 2. Find the product of the approximate numbers 
Xi = 12.4 and x^ = 65.54 and the number :i valid digits in it if 
ail the written digits in the factors are valid. 

A The first number contains three valid significant digits 
and the second number contains four. We can multiply the numbers 
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without previous rounding-oS, i.e. = 12.4*65.54 = 812.696. 
We must retain three significant digits since the least exact factor 
has the same number of valid significant digits. Thus a = 813. 
Let us calculate the error: 




Xm 


0.05 0.005 _ 

12.4 + 65.54 “ 


0.0041. 


Then Ag = 813*0.0041 ^ 3.4. This means that the product 
has two valid digits and should be written as i4 = 813 ± 4. 4 

The number of valid digits in the product. Consider a 
product of k factors (/c^ 10) a = • • • ^hi where 

ai 0. Each factor contains no less than n valid digits 

(« > 1 ). 

Assume that each of the factors has the form 


at ai . lO'' + p, . lO*'" ‘ + Yj • +••• 

2, k), (9) 


where ara the first significant digits of the approxi- 
mate factors written in the decimal notation. 

For the relative error of the approximate number which 
has n valid digits we use the formula 


0.5 


arl0^“^ 


(i = 1, 2, . . k). 


Then the relative error of the product of k approximate 
numbers, each of which has n valid significant digits, is 


6a ®ai + fiao + • • • + 


0.5 

lOn-i 



Taking into account that the number of factors is not 
larger than 10 (/c^ 10), we obtain 




ajj 


afe ^ 


and, consequently, 


6a< 


0.5 

lOn-2 


4c 

Thus, if all factors have n valid significant digits and 
the number of factors is not larger than 10, then the num- 
ber of valid digits in the product is one or two units less 
than n. In the case when the factors have different accu- 
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racy, we must understand n to be the number of valid 
digits in the least exact factor. 

Remark. When the number of factors is large {k > 10), 
it is convenient to use the statistical estimate which takes 
into account the partial compensation of the errors of 
unlike signs. Now if all the numbers at (i — i, 2, k) 
have approximately the same relative error 6, then the 
relative error of the product is assumed to be 

( 11 ) 

Example 3. Find the relative error and the number of valid 
digits of the product a = 84.76*8.436, where all the digits of the 
factors are valid. 

A Here = 84.76, = 8.436, tii = = 4. The product 

a = 715.03. .. itself begins with the digit 7, i.e. its ai = 7. Using 
now formula (10), we find that 

, 0.5 / 1 , 1 \ 0.5 

“ 104-1 ‘ \ 8 ' 8 / “■ 4104-1 • 

Comparing this result with the right-hand side of formula (4) 
from 1.5, we find that 

0.5 _ 0.5 _ 0.5 

(7 + l)-10«-i < 4-10«-» (7+l)-l()8-i • 

Consequently, the product has at least three valid digits. 

Let us verify whether this is so. We seek the absolute error 
using the formula = | a | 6^. We get = 715.1 *0.125 X 
10^3 ^ 0 09, It follows that the approximate value of the product 
has three valid digits and, with due account of the rounding error 
of the result, we can write 

A = 715.0 ± 0.2. 4 

Example 4. Find the relative error of the [product a = 145.35 X 
1.24386 and the number of valid digits in it if the numbers are 
given with valid digits. 

A Here Ui = 145.35, rii = 5, Og ” 1.24386, /ig = 6. These 
numbers have different numbers of valid significant digits. We 
choose n = 5, From formula (10) we obtain 

iQB-i \ 1 "!■ 3 / — 7.5*104-1 • 

Having calculated the product a == = 770.43..., we 

compare tne quantity 6^ with the right-jhiiw fte of formuAa <4) 
from 1.5: 

0.5 _ 0.5 _ 

(7+l)*104-i ^ 7.5*104-1 < • 

Consequently, the product has at limi three valid significant 
digits. 4 
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Thus, in an unfavourable case, the product of approxi- 
mate numbers may have ri — 2 valid significant digits 
(where n is the least number of valid significant digits 
of the given factors). 


1.8. The Error of a Quotient. The Number of Valid 
Digits of a Quotient 

The error of a quotient. Let us consider exact numbers 
i 4 i, and tlieir approximations with the abso- 

lute errors and A^^. We pose the following problem; 
evaluate the relative error of tlie approximate value of 
the quotient a = for the exact value A = AilA^^ 

Let ai ^ 0 , ^2 ^ We represent the exact values of 
A^ and A 2 in the form 

Ai Ui 1 - A|, A2 = (I2 + ^21 ( 1 ) 


where the unknowns A, and Ag satisfy the ine(j[ualities 
I K A,., I A2 K A.,,. ( 2 ) 

Let us consider now the difference 

^ ^ fli _ a2^i " 

0,2 - f * ^2 <*2 ^2 (^2 ~\r ^ 2 ) 

Having divided the right-hand and left-liaijd sides by 
a, we consider tlieir absolute values: 


rtl(fl 2 ~t“^ 2 ) fl 2 "bA 2 (l\ flo 


Bearing in mind that A, is small as compared lo ^2, 
we approximately set a2/{a2 + Ag) — !. Then, using the 
properties of absolute values and inequalities ( 2 ), we 
obtain 


A — a 
a 


fli 


^2 ^ I _ ^02 

«2 ^ l«ll ' l«2l 




Thus we can take the sum of the relative errors of the 
dividend and the divisor 


8a — + 6a2 

as the relative- error of the quotient a =a^la2- 


( 3 ) 
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When we use formula (3) to evaluate the relative error 
of the quotient, the most important contribution to that 
error is from the least exact (having tlie greatest rela- 
tive error) numbers. Therefore, when the dividend and 
the divisor have different relative errors, we usually 
do the following: 

(1) isolate the least exact number, i.e. the number with 
the least number of valid digits, 

(2) round off the second number, leaving in it one sig- 
nilicant digit more than there are digits in the isolated 
number, 

(3) retain as many significant digits in the quotient as 
there were in the least exact number. 

Knowing the relative error of the quotient, it is easy 
to find its absolute error using the formula 






(6ai + 6ao.). 


( 4 ) 


Example 1. Calculate the quotient a = x/y of the approximate 
numbers x = 5.735 and // ~ 1.23 if all the digits of the dividend 
and the divisor an* valid. Find the relative and absolute errors. 

A (t) We shall first calculate the quotient. Since the dividend 
X = 5.735 has four valid significant digits and the divisor has 
three, we can carry out the division without rounding-off. We have 
a = 5.735 1.23 = 4.06. We have retained three significant 

digits in the result since the least exact number (the divisor) con- 
tains three valid significant digits. 

(2) Let us calculate the relative error of the quotien* using 
formula (3) and bearing in mind that = 0.0005, tHy = J.005: 

= 6.^ -I- by = -f = ().()( 10(19 + 0 .0041 = 0 .0042 ^0.5%. 

(3) We seek the absolute error 


= I a I 6^ = 4.66-0.0042 = 0.02. 

With duo account of the rounding error 0.005, the final result 
must be written tks A = 4.66 zh 0.03. Note that the hundred’s 
digit is doubtful since 0.03 >- 0.005. If we write the result only 
with valid significant digits, we must round it off and take into 
account the rounding error. This requirement is satisfied only by 
the approximate number = 5 since = A^ + ^rounding “ 
0.02 + 0.4 = 0.42 < 0.5. 

At the same time, we cannot leave two valid significant digits 
in the approximate number a since then we would obtain Aj = 
and = 0.02 + 0.05 = 0.07 > 0.05 A 

9-0104 
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The number of valid digits in the quotient. Let the 

approximate numbers 

ai = aj.l0'‘ + a2.10'i~‘+ 


have n valid significant digits each. Then, using tlic 
equalities 

« 0.5 ^ 0.5 

“ ai- 10^-1 » — Pj. 10^-1 » 

we shall find the relative error of the quotient a = a^la^, 

r: n t; 

0.5 


0.5 


10 « 




( 5 ) 


Consequently, if 2 and Pi ^ 2, then the quotient 
has at least n — 1 valid significant digits. Now if aj = 1 
or Pi = 1, then the quotient may have — 2 valid sig- 
nificant digits. 

Example 2. Calculate the quotient a == 39.356 2.21 and hnd 

out how many valid significant digits it contains if all the digits 
in the dividend and divisor are valid. 

A (1) Since the divisor has three valid significant digits and 
the dividend has five, we round off the dividend to four significant 
digits and make the division. We have a = 39.36 -h 2.21 “ 
17.81 ^ 17.8 (we leave as many significant digits in the result as 
there are in the number with the smaller number of valid significant 
digits). 

(2) We can find the relative error using formula (5), where 
w = 3 since the least exact number has three valid digits; ~ 3, 
Pi ~ 2. Consequently, 



Comparing the quantity with the right-hand side of formula 
(4) from 1.5, we obtain 

0.5 0.5 ^ 0.5 

Il + D- 108-1 (1 + 1) -108-1 • 

Thus tb) quotient contains at least two valid significant digits, 
i.e. one significant digit less than the approximate number (the 
divisor) with the smaller number of valid significant digits.^ 
Example 3. Find the relative error of the quotient fl = 15.834 h- 
1.72 and the number of valid digits in it if the dividend and divisor 
have valid significant digits. 
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A The least exact number has three valid significant digits. 
We shall seek the relative error using formula ( 5 ): 

. _ / 1 , 1 \ ^^-5.2 

loa V 1 + 1 / ' i()8-i 

Calculating the quotient a = 9.20 and comparing the quantity 
with the right-hand side of formula (4) from 1.5, we find that 
the quotient contains only one valid significant digit, i.e. two 
valid significant digits less than the least exact number. ^ 

1.9. The Errors of a Power and a Root 

(loiisidor an approximate number which has a rela- 
tive error 6a,. Assutno that we have to evaluate tlie rela- 
tive error of degree a = Evideully, 

... 

m factors 

Tho rolaLive orror of l.he proHiicl is 

6a - " 6<n + 6aj-h . . . +6ai-- (1) 


m terms 

Tims, when we raise the approxiiaale number a to 
the power //?, its relative error i/icreases m times, lu prac- 
tical calculations, when we raise an approximate imm- 
ber to a power, we leave as many significant digits in the 
result as there were in the approximate number itself. 

Example 1. A side of tho square a — 36. .5 era (with an '^^•xuracy 
to 1 mm). Find the area of the square, the relative and the isolate 
error and the number of valid digits in the result. 

A (1) We calculate the area of the square: 

s= 36.52 = 1332.2 ^ 1.33-10^ cm^. 

(2) We seek the relative error of the area: 

6 , -= 26^= ^ 0.55%. 

(3) Now wo seek tho absolute error of the area: 

A 3 = 563 1.33.103.0.0055 ^ 7.4 cm^. 

With due account of the rounding error, we can write the final 
result as 

s = (1.33 ± 0.01) . 0103 m 2 . 

Thus the result has two valid significiint digits. ^ 

Note that in the broad sense the result of Example 1 has three 
valid significant digits. 


3 * 
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Let us consider an approximate number which has a 
relative error 6a,. We can show that the relative error of 
the number a = ^ is m times as small as the relative 
error of the number 

6.-4 «..• 

In practical calculations, when we extract a root of 
an aj’proximate number, we leave as many signilicant 
digits in the result as there were in the rad ic and. 

Example 2. Find out with what relative error and with how many 
valid significant digits we can calculate a side of the square if its 
area s = 16.45 cm^ with an accuracy of 0.01. 

A We have a= 1/5 = 4.056 cm; 




Art 4 .( )50 . ( ) .0( )03 =1.3- 10-3. 

Thus, with due account of the rounding error, we have A ™ 
4.056 zt 0.002 cm and the number of valid significant digits is 3. ^ 

1.10. The Rules of Galciilaling Digits 

There are certain rules for calculating digits which 
should be used whenever the calculation of the error may 
not be strict.*TIiese rules show how all the results must be 
rounded off in order, first, to ensure the specified accuracy 
of the final result and, second, to obviate calculations 
with extra digits which do not affect the valid digits of 
the result. 

Here arc the rules of calculating digits. 

r" When adding up and subtracting approximate num- 
bers, wo must leave as many decimal digits in the result 
as there are in the approximate number with the least 
number of decimal digits. 

2°. When multiplying and dividing approximate num- 
bers, wc must retain as many significant digits in the re- 
sult as "here are in the approximate number with the 
least number of valid significant digits. 

S'". When we square or cube an approximate number, 
we must retain as many significant digits in the result 
as there are in the base of the power. 
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4"". Wlicji extract a square or cubic root of an ap- 
proximate number, we must retain as many significant 
digits in the result as there arc in the radicand. 

5°. When calculating intermediate results, we must 
retain one digit more than rules l°-4° recommend. In 
the final result this “reserve” digit is dropped. 

6°. If some data have more decimal digits (in addition 
and subtraction) or more significant digits (in other oper- 
ations) than other data, they must be first rounded off, 
with only one “reserve” digit retained. 

7°. When we use logarithms to calculate a one-term ex- 
pression, we should calculate the number of significant 
digits in the given approximate number which has the 
least number of significant digits and use the table of 
logarithms which has one extra decimal digit. In the final 
result we drop the last significant digit. 

8"". If we take the data with an arbitrary accuracy, 
then, to obtain a result with rn valid digits, wo must take 
the initial data with the number of digits which, accord- 
ing to the preceding rules, ensure rn *-|- 1 digit in the 
result. 

Wo jiresent these rules on the assumption that the coni- 
])onents of the operations contain only valid digits and 
the number of operations is not large. 

Example 1. Calculate ^ where /I ^ 7.45 ± 

50.46 ± 0.02, = 15.4 zh 0.03. Find the error of then alt. 

A When we calculate the intermediate results, wo shall retain 
one “reserve” digit, i.e. if, according to the general rule we must 
retain n significant digits, we shall retain n + 1 digits in the iiitcr- 
inodiate results. We have 


413.5, /6 = 7.in35, 237.2, a:- 


413.5.7.1035 

237.2 


= 12.4. 


We have left throe significant digits in the result since the least 
nu rubor of significant digits in the factors is 3. 

We calculate the error of the result: 


2 


1 0 01 1 

0.0041-1-0.0002-1-0.004 0.000; 


0.02 

WM 
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12.4-0.009 ^0.12. 

The answer is X = 12.4 ± 0.12, = 0.9%. 

Example 2. Calculate X = i where -4 = 2.754 ± O.oOl, 

Z? 11.7 ± 0.04, M = 0.56 ± 0.05, C = 10.536 ± 0.002, D -= 

0.32 i 0.008. Find the errors of the result. 

A Wo find that 


a-\- b = 2.75 + 11.7 = 14.45, 



Therefore 


-h Aft -I- Arounding = 0.001 + 0.04 -| 0.004 = 0.045, 
536 - 6.32 = 4.216; Ac-d = 0.002 H- 0.008 = 0.010. 


14.45.0.56 14.45-0.56 


4.2162 


17.75 


-0.456^0.46 = 4.6-10-1; 


0.045 , 0.005 , 
14.45'^ 0.56 


0 .01 
4.216 


= 0.0( )31 1 + n.( K 1894 + O.0( >474 ^ ( 1 .02 2 % . 

Consequently, 

A^ = 0.46-0.02 - 0.01. 

Thus the result is X — 0.46 ±, 0.01, 6^ ~ 2%. 

Example 3. Using the rules of calculating digits, compute 

where h — 11.8, n = 3.142, r = 23.67. 

A We find that 

i; = 3.142*il^82 (23.67 - 3.933) - 3.142-11.82.19.737 
= 3.142-139.2-19.737 =- 437.37-19.737 = 8630 ^ 8.63. 10:J. 4 


Exercises 

1. Carry out the successive roundings-off of the follow! i^g nuin 
hers: (a) 2.75464, (b) 3.14159, (c) 0.56453, (d) 4.1945, (e) 0.60653. 

2. Rounding off the following numbers to three significant 
digits, find the absolute and the relative (in per cent) 6^ error 
of the resulting approximations: (a) 1.1426, (b) 0.01015, (c) 0.1245, 
(d) 921.55, (e) 0.002462. 

3. Find the absolute error A^c of the following approx i in ate 

numbers proceeding from their relative error: (a) x = 2.52, 6^ - 
0.7%, (b) j: - 0.986, 6^ = 10%, (c) a; = 46.75, 6^ = 1%, 

(d) X -= 199.1, = 0.01, (e) x = 0.86341, 6^^ = 0.0004. 

4. Find the number of valid significant digits for the following 
approximate numbers: (a) 39.285 zb 0.034, (b) 1.2785 zb 0.0007, 
(c) 183.3 zb 0.1, (d) 0.056 zb 0.0003, (e) 84.17 zb 0.0073. 

5. Find out which of the following two equalities is more exact: 
(a) 6/25 ^ 1.4 or 1/3 ^ 0.333, (b) 1/9 0.1 or 1/3 ^ 0.33, 
(c) 15/7 ^ 2.14 or 1/9 0.11, (d) 6/7 ^ 0.86 or n ^ 22/7, (e) n ^ 
3.142 or /lO s 3.1623. 
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Hint. First find the relative errors. The equality whose relative 
error is smaller is more exact. 

6. Round off the doubtful digits of the number A = 47.453 db 
0.024 leaving valid digits in it. 

7. Round off the doubtful digits in the number A = 46.3852 ± 
0.0031 leaving valid digits in it. 

8. Round off the doubtful digits in the approximate number 
a 3.2873 if 6^ = 0.1%, leaving valid digits in it. 

9. Find the relative and the absolute errors of the following 
approximate numbers if they have only valid digits: (a) a = 
0.7538, (b) a = 17.354. 

Hint. Use formula (3) from 1.5. 

10. Calculate the following expressions and evaluate their 
errors. In the answer retain all valid digits and one doubtful digit. 
All the numbers are given with valid digits- 

, , 3.07-326 36-245-85 

36.4-323 ’ 975-642 ’ 

_37.2 + 458-67 . 96.891—4.25 

36.5-246 ’ ^ 33.3-I-II-426 • 

11. Using the rules of calculating digits, compute: 

(a) s-=^- • where ,’8 = 2.73, a = 0.l52, 6 = <».328; 

(b) s-=-in(a=--fo2), where a -^0.937, 6 = 9.0630. 



Chapter 2 

Matrix Algebra and Some Data 
from the Theory of Linear 
Vector Spaces 

2.L Matrices and Vectors. Principal Operations 
Involving Matrices and Vectors 

A rectangular array which is composed of elements 
(numbers in special cases) and has m rows and n columns 
is a matrix of dimension m X riy or an m X n matrix. 
The elements of a matrix are designated as a,;, where i 
is the number of the row and / is the number of the column 
whose intersection is occupied by the clement. 

For instance, 


ail 

^12 


• • ®ln 

CL 21 

®22 


•• 0%n 

®31 

^32 


• • 

- ^mi 

®m2 

®7n3 • 

• • - 


is an m X n matrix which has m rows and columns. 

The abridged notation of the matrix is A = 
where i = 1, 2, . , m^ / = 1, 2, . . ., n, or 

If the number of rows in a matrix is not equal to the 
number of columns, i.e. m then the matrix is called 
rectangular, 

A matrix which has only one row, i.e. m = \ is a 
row matrix (or row vector)^ for example, 

A = [aiiai 2 il or i4 = [1 2 3 4]. 

A matrix which has only one column, i.e. n = 1, is a 
column matrix (or column vector), for example. 
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In what follows, wc shall call a row matrix or a 


column matrix a uectoj' and designate it as x — 


X2 


L^n J 

or as X = U’l, The numbers 

are the coordinates (or elements) of the vector x. Since the 
number of coordinates of a vector is, by definition, its di- 
mension, the vector x is n-dimensional. 

If the number of rows in a matrix is equal to the number 
of columns, i.e. m = n, the matrix is square, A matrix of 
this kind can be written in the form 


A- 


an ai2 

^21 ^22 


«171 

dzn 


^nt ^712 • • • 


For a square matrix the total number of rows or columns 
is called the order of the matrix. 

The principal diagonal of a square matrix is the diago 
iial extending from the upper left to the lower right cor- 
ner, i.e. a set of elements of the form an, where i = 
1 , 2 , . . ., 11, 

A square matrix in which all the elcmojils wliich lie 
oulsidc of the principal diagonal are zero, is called a 
diagonal matrix. This matrix has the form 






0 

0 


0 0 
^22 


0 

0 

0 


LO 0 0,,.annJ 


A diagonal matrix all of whose elements on the princi- 
pal diagonal are equal to unity is an identity (or unit) 
matrix. An identity matrix is designated as I and has the 
form 


I 


n — 


1 0 0 
0 10 
0 0 1 
0 0 0 


0 

0 

0 

i 
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The index n indicates tlic order of the identity matrix. 
In matrix calculation the identity matrix plays the part 
of unity. 

A square matrix all of whose elements arc symmetric 
about the principal diagonal is a syniiaetric rnairix. 
The equality Uu = aji (/ ^ j) holds true for a symmetric 
matrix. For example, 

[1 2 4 I 
^-235 
[4 5 ej 

is a symmetric matrix. 

A matrix all of whose elements are zero is a zero, or 
jiull, matrix and is designated as 0. If we have to indi- 
cate the Jiumber of rows and columns, we write 


"0 

0 

. .. 0“ 

0 

0 

... 0 

0 

0 

. .. 0 


Two matrices A = [a^] and B = [bij] are equal if 

(1) they are of the same dimension, i.e. the number of 
rows of the matrix A is equal to the number of rows of 
tlie matrix B and the number of columns of the matrix 
A is equal to the number of columns of the matrix B, 

(2) the respective elements of these matrices are equal. 
Thus, if 

bii bi2 • • • 

621 ^22 • • • b 2 n 


^mi ^m2 • • • 

and dij = frfy (i = 1, 2, . . ., tn, / = 1, 2, . . ., ji), then 
A = B. 

The 5am of two matrices of the same dimensioji A + 
^ + [bij] (i 1, 2, . . ., m, / ^ 1, 2, . . ., n) 

is a matrix C = [cjjl of the same dimension whose ele- 
ments Cij are equal to the sums of the respective ele- 
ments and bij of, the matrices A and B, i.e. = 

+ bij. \ i 


flu fli2 ... flin 
fl21 ^22 • • • ^2jl 

®mi “m2 • • ■ “mn 


B 
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The difference of matrices is defined by analogy with the 
sum of matrices with the only difference that the signs of 
the elements of the subtracted matrix are changed to the 
opposite, i.e. D = A — B, = an — {i = 1,2, 
. . 7 / 1 , 7 = 1,2, . . n). 

The product of the matrix A = [an] hij the number a 
is a matrix whose elements result from the multiplication 
of all the elements of the matrix A by the number oc: 



(X(Z|^ OL(li2 • * 


a.-l- 

0CfZ21 ^^22 • • 

. aa2n 


<xami • • 



The matrix —.4 = (—1) A is the inverse of the matrix A. 
The additi.i ' of matrices obeys the following laws: 
(r) A H- {B + C) ^ {A + B) H- C\ (20 A B = 

B -]- A, (30 A + 0 = /I, (40 1- i-A) = 0. 

The product of a matrix by a number obeys the fol- 
Jowijig laws: 

(10 i-A =/l, (20 0 -.4 = 0, (30 a((L4) = {a^) A. 


Example 1. Assume that 



■ 1 2 3 4" 


"1 - 

-1 

2 -7" 

A = 

— 2 0 4 5 

— 7 6 12 

: «= 

4 

1 - 

3 - 

-6 

-2 -4 

0 —1 


- 1-14 3- 


-2 

3 

4 -5- 

Then 

' 2 15 —3’ 



1 

' 0 3 


2 3 2 1 

-6 0 1 1 

: 

A-B = 

— 6 -3 

— 8 12 


- 3 2 8 —2 



1 

--1 -4 

Example 2. The product of the matrix 




1 3 

-4' 




A-= 

0 1 

_ •) 





- — 3 1 

5_ 



by llie number 2 is a matrix 






' 2 6 

-8 




2Ar= 

0 2 

-4 

. 




^-6 2 

10 
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The product AB of two matrices 


dll 

ai 2 . 

• ^iii 


'bti 

tl 2 . 

• • biq 

^21 

^22 • 

• ® 2 n 

and B — 

&21 

622 

• • bzq 

^mi 

®m 2 • ■ 

■ • ®mn 



bn2 • 

• • bjiq ^ 


wJiicli have diincnsioJis rn X n aJid n X q respect ivcdy, 
is a jtialrix 



^^11 

C12 . 

• • ^iq 

t’ = 

C21 

C22 • 

• • (^ 2 q 



^Wl 2 • 

• • ^mq ^ 


of dimension m X q. Note that the matrix C -- AB 
is dcliiHid only when the number of columns of the matrix 
.1 is equal to the number of rows of the matrix B. 

The elements of the matrix C can be calculated accord- 
ing to the following rule: to obtain the element ctj which is 
in the ith row and the jth column of the product of two mat- 
rices, the elements of the ith row of the first matrix must be 
multiplied by the corresponding elements of the jth column 
of the second matrix and the resulting products summed up: 

c,j‘^ I- -1- • • • -1- Ui„bnJ 

{i = 1,2,..., tn, 7 = 1,2,.. ., (J). 

For eXfiniple, c.,;, — I- «a2^2.'i + • • • -F <‘-’nbn;„ 

^41 ^41^11 "I” ^42^21 • • • ~1 ^1^* 

Example 3. [ J J J] 

La 1- 

r3-2-f-2.1 + 8-(t+l-3 3(-1)-|-2-(-3)-1-8-1-|-M T 

"■Li-2+(-4)-1 + ()-() + 3.3 1(-1) + (-4).(--3) + O.H-3.iJ 

ril O-j 
L 7 14j • 

Here AB= laj7J»x4‘l*’l7l4xa = ^=I‘'»/l»»»- 
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Example 4. 


ri2 3irn rM-i-2 

4 5 6 2 

17 8 91 3j L7-1-1-8 


2. 2 + 3. 3 
5.2-1-63 
8. 2+9-3 



■14“ 


32 

50 


Here AB = v3 [6i;.]3 . i= [c; jJsxi. 
Example 5. 


2n r5 6+ri. 5 + 2-7 1-6 + 2-8+ ri9 22-1 
13 4j L? 8J-L3-5 + 4.7 3.6-1 4.8j“ +43 50J ’ 

5 2 1-6.4-] [23 34-1 

17 Sj [3 4J L7.I + 8-3 7.2 + 8.4J 13146]’ 


i.e. AB +: BA, 


Example 6. The product AB = 



■3 2 4' 
2 1 3 
4 3 0 


[1.3-f-2.2-|-3.4 12 I-2-I+3.3 l-4-|-2.3 + 3.()-] 
L^4-3-f b. 2 + 6-4 4.2 + 5.I + 6.3 4. 4-1-5. 3-1-6. oj 


[19 13 10-| 
[46 31 3lJ ’ 




3 2 4' 
2 1 3 

4 3 0 . 



does not exist since the nuinbor of columns of the matrix A is 
not equal to the number of rows of the matrix B, 


The product of matrices obeys the following laws: 
(V) A (HC) {AB) C, (2 ) a [AB) --- {aA) B, 

(:r) {A -[- B)C ^ AC -I BC, (4") EA - +. 


Note tliat AB BA, i.e. in the general case liie pro- 
duct of two matrices does not possess the property of 
commutativity. The only exception is an identity matrix. 
A I = fA = A, This means that in the general case we 
cannot interchange the factors without changing the pro- 
duct. When we change the order of the factors, it may 
turn out that it is impossible to carry out the multipli- 
cation at all (see Example G). 

We say of the product AB of two matrices + and B 
that the matrix B is premultiplied by 'he matrix A and 
the matrix A is postmultiplied by the matrix B, 

The product of several matrices ABC must be under- 
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stood as follows: the matrix A is postmultipliod by the 
matrix B and the resulting matrix is postmultiplied by 
the matrix C, etc. The number of multiplied matrices 
may be arbitrary, the only condition being that two adja- 
cent matrices can be multiplied. 

The matrix is the nth power of the matrix A, If 
is a square matrix and n is a positive integer, then 

A^=r-.A^A-A ... A. 


n factors 


The operations of addition of column matrices and row 
matrices (i.e. vectors) and multiplication of them by sca- 
lars are similar to the corresponding operations involv- 
ing square matrices. Thus the sum of two vectors x = 
[x^x^ . . . Xj^] and y = [?/i]y 2 • • * i/nl is a vector z = 
with the coordinates z^ = x^ -j- Zo — 
•^2 + ^/2 • • M -\~ ijn’i product oj the rector 

X = [xiX< 2 . . . . a^yil by the scalar a is a vector z ~ 
ax = laxi ax2 . . . ax^l. 


Example 7. The sum of the vectors x — [1 2 3] and y- 
[~5 —2 4] is a vector z = [ — 4 0 7]; the product of the vector 

- - 2- 

■ 

by the scalar a~2 is a vector 


" r 
2 


4 

--6 


2.2. Transpose of a Matrix 

If we replace the rows of the m X Ji matriv 


an 

aia • ■ 

• • a^^ 

ttgi 

a22 . 

. . fl2n 

ami 

am2 • • 

• ^mn 


by the corresponding columns, we obtain an // X ni 
matrix 



*aii 

fl21 

... Ojni 

A'^~- 

ai2 

• • 

022 

. . . ajn2 


am 

^2n 

■ • • ^mn 


which is known as the transpose of the matrix A. 
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Example 1. The transpose of the 3x4 matrix 



is a matrix 

" 12 1 
T_ 2 0 2 

-3 4 3 
- 5 2 4 

of dimension 4x3. 

Example 2. The transpose of the row matrix — [1 2 3 4] is 

a column matrix = 

Noto thr following properties of transposition. 

1*". If we transpose the matrix A twice, it will remain 
unchanged: 

UT)T == 

2'\ The transpose of the sum of two matrices is equal 
to the sum of the transposed matrices: 

(A i?)T = ^ 

This follows from the dehuition of the sum of two matri- 
ces. 

3°. The transpose of the product of two matrices i- ,)qual 
to the product of the transposed matrices taken in the 
reverse order: 

(AH)^ = B^A^. 

The matrix (AB)"^ has resulted from the multiplication 
of the elements of the rows of the matrix A by the ele- 
ments of the columns of the matrix B followed by the 
replacement of the rows by the columns. Wo can get the 
same result if we multiply the elements of llie columns 
of tlie matrix B (the rows of B^) by the elements of the 
rows of the matrix A (the columns of A^), 
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2.3. The Determinant of a Matrix. The Properties of 
the Determinant and the Rules of Its Calculation 


Lot A be an arbitrary square matrix of order n: 



flu 

ai2 . . . 

flin' 


fl21 

^22 

fl2fl 

A = 

_flni 

fln2 • • • 

fljin _ 


The matrix A is associated with a determinant wliich can 
be designated as d, Z), dot A ov \ A | : 


D= det A 


Ml- 


flu 

fll2 ••• 

flin 


fl21 

^22 • * 

. • • . 

fl2n 

( 1 ) 

flftl 

(Iji2 . . . 

Ann 



Tlic determinant of a matrix is a number which can bo 
calculated in accordance with certain rules consider(*d be- 
low. 

There are two diagonals in a determinant, a principal, 
or leading, diagonal and a secondary diagonal. I'be 
principal diagonal of a determinant, as that of a siiiiare 
matrix, consists of the elements where i — 1, 2, 
. . ., A^. The secondary diagonal is perpendicular to the 
principal diagonal and passes from the upper right cor- 
ner of the determinant to its lower left corner. The order 
of a determinant corresponds to the order of the matrix 
with which it is associated. 

If the order of a matrix is unity, i.e. the matrix consists 
of one element then the first-order determinant asso- 
ciated with this matrix is a number equal to that ele- 
ment. 

Consider a second-order square matrix 

Lflai ^22 J 

The xcond-order determinant corresponding to this 
matrix is a niiml)er 


d^t >1 - — ^19^21- 

021 "22 ** 


(2) 
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Formula (2) ^];ivos tlie riilo of calculating a second-order 
determinant: a .second-order determinanl is equal to the 
product of Ike elements of the principal diagonal minus the 
product of the elements of the secondary diagonal. 


Example 1. Calculate the determinant of tlio matrix 



A (letA^^ 


1 2 
4 5 


-1.5 -4*2 


-3. A 


A- 


A third-order determinant is a number 


del 


A 


— a 
~ a 


6^12 ^^13 
^ 2l ^22 ^23 

<2.31 a ^2 ^33 

iF^22^33 ^^13^21 

13^22^^31 


(hi 

^^33 ^ 3 *^ ^ 33^^11 ■ 


(3) 


Thus erery term of a third-order determinant is the pro- 
duct of three of its elements, taken one from each row and 




Fig. 2.1 


Fig. 2.2 


each column. These products are taken with definite signs: 
three terms consisting of elements of the principal diagonal 
and of the element which are at the vertices of isosceles tri- 
angles with the bases parallel to the principal diagonal are 
taken with the plus sign (Fig. 2.1); three terms which occu- 
py similar positions relative to the set ‘ ud ary diagonal are 
taken with the minus sign (Fig. 2.2). This rule is knowFi as 
the rule of triangles. 


4-0104 
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Example 2. 



Calculate the determinant of the matrix A = 


A 


det >1 = 


1 2 3 

— 4 5 — 1 

2 1 2 


l-5‘2+3-l.( — 4) + 2.(-l)-2 


-2-5.3-l-(-l)-l~2‘(-4).2=~19. A 


Let us consider now a determinant of any order w, 
where n'^ 2. To calculate such a determinant, we must 
introduce the concepts of a minor and a cofactor. 

The minor of the element Uij of a determinant of order 
w ( 1 ) is a determinant of order {n — 1 ) which can be ob- 
tained from the initial determinant by deleting the ith 
row and the 7 th column (the row and the column whose 
intersection is occupied by the clement Uij), 

The miuor of the element aij is designated as 
The first index here denotes the number of the row and 
the second, the number of the column which are deleted. 
For instance, in the third-order determinant 



ail ®12 fli3 
^21 ®22 ®23 
^31 ®32 ®33 


the second-order determinant 


M 


12 


®2l ^23 
®81 ®33 


is the minor of the clement ajg* 

The cof actor, or algebraic adjunct, of the clement aij 
of the nth-order determinant ( 1 ) is a number 




Evidently, if the sum i j is even, then the cofactor has 
the sanje sign as the minor, now if the sum i ^ 7 is odd, 
then the sign is changed to the opposite. 

Theorem 1. A determinant is equal to the sum of the pro- 
ducts of the. elements of any row (column) by the corre- 
sponding cofactor: 
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flu fli2 • ■ • «in 

det A = ""22 • • . ^2n 


I ^711 ^712 • • • ^7171 

‘ "1“ ^i2'^i2 I' • •• f' ^in'^in ~ ^ 

J^i 

(i = l, 2, .... n) (4) 

or del A n,jA,j + a 2 jA 2 j + • • • + a„jA„j 

-■ 21 aijA^j 2, n). (f,) 

i==l 

Formula (4) is the expansion of the determinant according 
to the elements of the ith row and formula (5) is the expan- 
sion of the determinant according to the elements of the jth 
column. 

When we expand a second-order determinant according 
to the elements of any row (column), we get formula (2) 
given above, and when wo expand a third-order deter- 
minant according to the elements of any row (column), 
we get formula (3) (the rule of triangles). 

1 1 2 

Example 3. Calculate the determinant ^^— 34 by expanding 

it according to the elements of the first row. 

A According to formula (4) we have 

d — anAii + ai2Ai2« 

Since All- ( — Ai2 = (— _3^ hav d- 
1.4 + 2(_3)==-2. a 

3 2 1 

Example 4. Calculate the determinant d= 2 5 3, expanding 

3-12 

it according to the elements of the second column. 

A From formula (5) we get d" 012^12 -t-a22A22-|- 032^32- Next 
we find that 

= ^|=-(4-9)-5; 

2| = G-3^3; 

whence d — 2-5-[-5-3-| 4 ( — 7)-- — 3. ^ 


4 * 
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Theorem 2 (corollary of Theorem 1). If all oj the ele- 
meats of the ith roir (column) of the determinant rf, except 
for one^ say, Otu, are zero, then the determinant is equal to 
the product of the element by its cofactor, i.e. 


d UihAfff, 


(0) 


Example 5. Calculate the fourth-order determinant 
1 1 4 

10 0 4 

^ ~ 3 0 0 2 ’ 

0 0 - 5 -11 


expandimr it accortliuL*; to the elements of the second r(dumii. 

A Since ~ ^ 42 ' we find from formula (0) that 


(] ^12-^ 12 


l.(_i)l+2 


1 0 4 
302 

0 --5 -11 


whence, ajrain expanding the resulting third-or<ler determinant 
according to the elements of the second column, vve obtain 


d- -(-5)(-l)^+‘^ 


1 4 
3 2 


-3(2 -12) -50. 4 


Theorem 3. The sum of the products of the elements of n 
roir or a column of a determinant by the cofactors of the 
corresponding elements of the parallel roir (or column) 
is zero. 

Thus, for the third-order determinant 


ail ai2 ai3 
^2l ®22 ^23 

®31 ^32 ^33 

tliero hold equalities ^ 21^11 + ^ 22^12 ^ ^ 23-^13 

^ 31 ^ 21 “! ^ 32^22 ^ ^ 33^23 

Here are the properties of the det(^rminant. 

I"". The determinant does not chanf^e upon Iransposition: 



flu 

aj2 • 

• ®in 


flu 

Ogl • 

• ^nl 

let A = 

^21 

^22 • 

®2n 

~ 

012 

^*22 * 

• ®a2 


^nl 

a^2 • • 

• ^nn 


fllTl 

®2n • ■ 

• ^nn 


This means that the rows and the columns of a determi- 
nant are equivalent. 
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It follows from this property that the determinant of 
the matrix A Is equal to the determinant of the transposed 
matrix 

For example, 

12 3 1—4 2 

del A— —4 5 —1 2 f) 1 

2 1 2 3 12 

-1-5.2 I 3-( -4)-l !-2.( - l).2-3-5-2 -l.( -1)-1 
-2.(- 4). 2----- - 10. 

2 ’. If one of the roins or one of the columns of n determi- 
nant consists of zeros^ then the determinant Is eijual to zero. 

For example, 

0 1 2 

det/1-- I) 3 4 

0 10 15 

^^0.3-15 + 0.1 .4 + 0.2.10 — 0.3-2 
— 0.1.15 — O-i-lO^li. 

.'5'^. [Vhen two rows or two columns are i n tf r changed, the 
determinant only changes sign. 

For example 

1 2 3 

det 2 1 2 

-■4 5 -1 

- I.l.(-1) + 2.2.(-4) f2.5.o-3.1-(-l) 

-5-2-1 -2-2. ( — 1) -10 

(compare with the example which illustrated property O'). 

'i"". A determinant which contains two identical rows or 
two Identical columns is equal to zero. 

For exairiple, 

1 2 3 

det.l- I 2 3 -- l•2-2-^ 2-3-2H I -1-3 2 - 2-3 1 - 2 - 2 - 1 - 1 -3- o. 

2 1 2 

5°. If all the elements of a roir or a dumn of a delerm. 
riant are multiplied by the scalar k --/= L, then the determi- 
nant Itself will be multiplied by that scalar. 
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3 6 

9 


1 2 3 

dot A — 

2 1 

2 

= 3 

2 1 2 


—4 5 

— 1 


—4 5 —1 


Here is another formulation of this property; the com- 
mon multiple of all the elements of some row or some co- 
lumn can be taken outside of the sign of the determinant. 
For example, 


- 3 . 19-57 


(compare with the example which illustrates property 3°). 

A determinant which contains two proportional rows 
is equal to zero. 

For example, 


— i). 


7°. If all the elements of the iih row of an nth-order deter- 
minant are represented as the sum of two terms^ i.e. atj — - 
bij + Cij (7 — 1,2,..., n), then the determinant is equal 
to the sum of two determinants in which all the rows, ex- 
cept for the ith row, are the same as those of the gicen deter- 
minant, and the ith row in one of the terms consists of the 
elements bij and in the other terms, of the elements Cij: 

del A 



3 6 9 


1 

2 3 

det A ~ 

12 3 

= 3 

1 

2 3 


2 1 2 


2 

1 2 


“11 



“12 ^ 

13 






“21 


1 ^ 2 l “22 — ^ 22 ^■^ 22 “ 23 ~ 

^23 + ^23 

• • “271 

- hn - 

h ^271 

“31 



“32 ®33 



• • • “371 



“nl 



“712 “h 3 



. . . 




“11 

“12 

“13 • • • “iTl 


“ll 

“12 

“13 • • 

“l/l 



^21 

^^22 

^23 • • . ^271 


^^21 

^22 

^23 • • 

^211 



“31 

“32 

“33 • • * ^371 

+ 

“31 

“32 

“33 • • 

' “371 

• 


“n 1 

“712 

“713 . * • “hti 


“711 

“n 2 

“713 • • 

• “7171 



For example, 



2 7 9 


1 3 4 


1 4 5 

det A = 

1 3 4 

1 0 2 

— 

1 3 4 
1 0 2 


1 3 4 

1 i) 2 


= 0 - 1 =^ - 1 . 


8®. T f one of the rows of a determinant is the sum of some 
other rows or the sum of the products of some other rows of 
the determinant by the scalar k, then the determinant is 
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equal to zero, (This follows from properties 6° and 7" 
of a determinant.) 


For example, 



1 2 3 


1 2 3 


1 2 3 

det A = 

3 2 7 

1 0 2 

— 

1 2 3 

1 0 2 

+2 

1 0 2 

1 0 2 


13°. The determinant will not change if the elements of 
one of its rows (columns) are summed up with the corre- 
sponding elements of some other row (column) multiplied 
bij the same number. 


For example, deti4 = 


2 7 9 
1 3 4 
1 0 2 


= — 1 (see the example which 


illustrates property 7°). We multiply the third row by 3 and sum 
up with the second row. We obtain 


det A = 


10 7 9 

4 3 10 
1 0 2 


-=2-3-2-l l*7-10 + 4.n-9 — 1-3-9 — 4-7-2 — 2.0.10^ — 1. 

Using these properties of a deterniiiiarit, we can sim- 
plify the calculations of an nth-order determinant. Trans- 
formations which do not alter the value of a determinant 
are said to he elementary. 


Example 6. Calculate the determinant 

1111 
_1 2 3 4 
_2 3 6 10 ’ 

3 4 10 20 

expanding it according to the elements of the first column. 

According to formula (5), £/ — fluAn 1 021-^21 

^ 41 ^ 41 * We seek the co factors. We have 



2 

3 4 


2 3 2 


3 

6 10 

= 2-2 

3 6 5 

4 10 20 


2 5 5 


-4 



— 3 


3 2 
5 5 


1-2 


^ 2 )=4(2.5-3-5 + 2.3) = 4. 


We have pul the coininoii multiple 2 ' ^ the third row and the 
common multiple 2 of the third column beioi'o the sign of the deter- 
miuant i4„ aud tlu'ii expanded the resulliug determiuaut according 
to tho elements of the first column. 
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We calculate 


^ 21 -(- 1 )*^^' 


1 1 1 


1 1 1 

3 6 10 

= -2 

3 0 10 

4 10 20 


2 5 10 


= - 2 ( 


0 10 
5 10 


+ 


3 6 
2 5 


-- — 2(10-l()-|-3)_ -0. 


We have put the coiiinion multiple 2 of the third row before; I he 
sig of the determinant and expanded the determinant according 
to the elements of the first row. 

By analogy we obtain 




1 1 1 


1 1 1 

2 3 4 

= 2 

2 3 4 

4 10 20 


2 5 10 


( ^ 

4 


“ 1 

2 3 

\ 

i 5 

10 


2 10 ' 

2 5 

1 


= 2(10-12 + 4)-4; 
1 1 11 




-( 


2 3 4 

3 6 10 
2 


3 10 


2 3 

3 6 


51) 


-—6 + 8 - 3 - - 1 . 


Expanding the deleriiiinant A accor»ling to tiu* elements ol the 
first column,, we finally obtain 

r/= i.4 -I- (-1)-(-6) -H (~2)-4 + 3.(-1) - - 1. A 

We can considerably simplify the calculation of a de- 
terminant if, using the properties of the determinant, 
we transform it so that formula (()) can lie used in calcu- 
lations. 


Example 7. Calculate the determinant 

1111 
-12 3 4 
— 2 3 0 10 
3 4 10 20 


using eLiiientary Iraiisforiiiations. 

A Using the elementary transformations of a (ietermiriani , 
we turn all the elements of the first row, exc(;pt for - 1, into 
zero. For that purpose, without changing the first column, we 
multiply all of its elements by (—1) and add successively to the 
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sec<nid, the third and the fourth column. Wo obtain 


1111 


1 n n 0 

— 12 3 4 


13 4 5 

— 2 3 <i 10 


1 5 8 12 

3 4 10 20 


1 1 7 17 


3 4 5 

- 1 •( - 1)^+1 5 8 12 . 

1 7 17 

In the nisulling third-order delerininant vve again lurn all c>f 
the elements of the third row, (‘xcepl for tiie lirst, into zero. Kor 
that purpose, without changing the lirst column, we Jiiultiply it 
consequently by (—7) and (—17) and add succ.essively to the second 
and the third column. We expand the resulting del(*riuinant accord- 
ing to lh(* elements of the third row: 

3 —17 —46 , 

</= 5 -27 -73 _ 2? _v!i’ - A 

1 li 0 ' 

2.4. The Inverse Matrix 

i\ s(iunrL* inalrix is said to he the inverse of a given square 
matrix if ils preimiltiplication and post mull ipliealioii hy 
the given matrix yield an identity matrix. The inverse 
of tile matrix A is designated as A *. lly dolinition, 

.1.4 ' - A - y. (1) 

A sqnari* matrix is said to he nonsnif^ndar (invf'rtihle) 
if its determinant is nonzi*ro. Now if the detern nant 
of the matrix is zero, (hen the matrix is sinful, r (or 
noninvertihle). 

Thc<)rein. For the square matrix A to hare an inverse, 
(t IS necessanj and sujficient that the delernunant of the 
matrix A he nonzero, i.e. that the matrix A he nonsni^ular. 

The proc(*ss of linding an inverse of a matrix is known 
as lh(' inversion of a matrix. 

lad ns (*onsid(*r tlie process of the inversion of a matrix. 
Let 



^^711 ^112 
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be a noiJsingular square matrix of order n whose deter- 
minant d = 7 ^ 0. We compose a matrix of the cofactors of 
the elements of the given matrix and then transpose it. 
The resulting matrix is known as an adjoint, or conjugate, 
matrix with respect to the matrix A and is designated as 

A: 



-^11 

A 21 . . 

• ^ni 

li 

-^12 

A 22 • • 

• ^n2 


^ ^nl 

Afi2 . . . 

“ ^nn _ 


Calculating the products AA and AA according to the 
rules of multiplication of matrices, wo obtain 


^2 = Z4 = dL (4) 

□ We shall prove the validity of equality (4) using 
the example of a third-order matrix. Assume that 



ail ai2 ai3 


All -^ai -431 

A== 

<*21 ^22 ^23 

and A ^ 

4 12 4.22 ^32 


-^31 ^32 ^33_ 


^4 13 423 433_ 


Then 

-= I + + ^23^13 ®2l^2l + ®22^22 

“("^32-^12 13 “t" ^32^22 

+ 013-^23 ®H^31 "l“fll2^32 + fll.vt;,3'| 

+ %3-^23 fl2l^31^"®22^32^'®23^33 I . 

H'®33^23 ^31-^31 4" ®32^32“1" ^33-^33 J 

In accordance with Theorem 3 from 2.3, all the ele- 
ments of the product A A, except for the diagonal ones, 
are zero. Consequently, 

[ d 0 01 ri 0 01 
d 0 U d 0 1 0 ^d/. 

0 0 dj lo () 1 J 

We can show by analogy that AA = dL ■ 

Since A A ^ A A ^ dl, with d = 7 ^ 0 , it follows that 

4 = 4 -'- 



Ch. 2. Matrix Algebra and the Theory of Linear Vector Spaces 59 


On the other hand, by the definition of the inverse mat- 
rix, we have 

AA-^ = A-^A = /. 

Comparing the last matrix equalities, we get a formu- 
la lor seeking the inverse matrix: 

^ A^ild A^ild 

A~^ — Aid — Aijd A^ild A^^ld . 

- 4 13/d A^fild A’^^ld 

In the general form, the inverse of a nonsingiilar square 
matrix of order n can be calculated by the formula 

[ Auld A.^ild ... A^i/d" 

Ai2/d A^^ld ... Aj,dd , ( 5 ) 

A\jild A^nld . . . Aiiji/d 

i.e. the of the original and the inverse matrix 

are related as ajj = Ajjd, 

Example 1. Find the inverse matrix A-^ of the matrix 

2 3 3' 

A- 1 2 3 . 

2 4 5 


^ (1) We calculate the determiiiaut of the matrix A: 

2 3 3 

d-= 1 2 3 --2.2.5 + 3-3.2 + 1-4.3-2-2-3-1-3.5--4-3-2-- -1. 
2 4 5 

Since d the inverse matrix A~^ exists. 

(2) We find the cofactors of the elements of the matrix A : 


- 13 

2 3 


2 3 

Ai 2 — 2 5 “ C ^22 = 

2 5 

— 4, A 32 — — 

1 3 

. 1 1 2 [ 

2 3 


2 31 

^13— 2 4 ^2:1— — 

2 4 

— — 2 , A 33 "— 

1 2 I 


(3) We compose an adjoint matrix 


All ^21 A;,l 


- 2-3 31 

A] 2 A 22 A ;|3 


1 4 -3 

^Ai3 A23 A;j3__ 


n —2 1. 
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(4) Wo calculate the inverse matrix 

2 3 —3 

A-^-^ AId ' 


— 1 
0 



2 3 31 

■ 2 3 -31 


n 0 n-| 

Verification: AA~^~ 

1 2 3 

— 1 —4 3 

— 

1) 1 0 


.2 4 5, 

.6 2-1 


() 0 1 


Example 2. Inverse the matrix 


A-= 


A (1) We calculate 


{/ — 


' 1 2 

4 

3 1 

1 

— 2 3 

-1 

1 2 

{) 

1 2 

4 

3 1 

1 

— 2 3 

-1 

— 1 2 

0 


-3 

1 

U 


--3 

1 

1 


for which purpose we expand the (leterminanl according to llu» 
eleirienls of the first row. We have 


^u- 


n.T - 


^14 - 


1 1 

3-1 
2 0 

3 

-2 - 
-1 
3 1 
-2 3 
-1 2 
3 I 
-2 3 
-1 2 


- --l-f-2-(3 -3- 


3 

1 
1 

1 —3 
1 
1 


1 

() 

— 3 

1 

1 


-3-11 3 1-2)--. -1. 


-y-l f 12-t) 12-6 -7. 


(1 


3 + 6)- -6. 


Consequently, 

d l.(-8) + 2.(-l) + 4-7 + 2.(-()) - 6, 
i.e. the inverse matrix exists. 

(2) We calculate the other cufactors of the elements of the 
matrix A: 




2 4 2 

3 -1 1 =^-(-2 I 8 + 4-12) = 2; 
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1 4 2 

A 22 -- —2 —1 1 —1-4-2 |-8r-l; 

-- 1 0 1 
1 2 2 

>l23--- —2 3 1 - —(3 — 2 — 8 ^6 + 4 — 2)- —1; 

— 1 2 1 

1 2 4 

~2 3 -1 ---2-^1()-| 12-1 2-1); 

— 12 (I 

2 4 2 

1 1 -3 -2 -24 — 4-4- ~3'); 

2 0 1 

1 4 2 

3 1 —3 ----(1 1 12 1 2-12) --3; 

— 1 0 1 

1 2 2 

3 1 —3 -1 |-6-l-12 + 2 + G-()--21; 

-12 1 
1 2 4 

3 11 __(_2-|-24 -[-4--2)- -24; 

— 12 0 

2 4 2 

- 1 1 —3 ---(2 -30 — 2 -0-0 — 4) -r>2; 

3 -- 1 1 

1 4 2 

3 1—3-1 1-24-0 + 4-12-3-8; 

-2 —1 1 

1 2 2 

^ 43 ^-- 3 1 -3 ---(1 + 12-1-18 + 4 + 9-6)- -38; 

-2 3 1 

12 4 

A 44 - 3 1 1 - - 1 - 1 I 30 f 8-3 + 0 -42. 

-2 3 —1 

(3) We compose an adjoint matrix 

'/111 >l 2 i 2-30 52- 

^ /I 12 A 22 /I 32 /I 42 1 - 3 8 

/I 13 /I 23 /I 33 /I 43 ^ 21 38 

_i4i4 i424 /I 34 /I 44 - - — 6 0 24 42- 


A24 

/I31 “ 

A ']2 

^33 “ 

/I34 

/I4I 

/I42 ~ 
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(4) We divide all of the elements of the adjoint matrix by 
d = 6 and obtain an inverse matrix A~^: 

■-8/6 2/6 —30/6 52/6" 

-1/6 1/6 -3/6 8/6 

7/6 -1/6 21/6 -38/6 * 

- — 6/6 0 —24/6 42/6 


Verihcation: 



" 1 2 4 2" 


-8/6 

2/6 

— 30/6 

52/6' 

AA-^^ 

3 1 1-3 


-1/6 

1/6 

-3/6 

8/6 

-2 3-1 1 


7IC) 

— 1/6 

21/6 

-38/6 


--1 2 0 1 . 


--6/6 

0 

-24/6 

42/6 - 

1 

--8—2 + 28-12 

2+2- 

-4 + 0 




6 6 


-24-1 + 7 + 18 
6 

' 16-3 — 7-6 
6 

8 - 2 + 0-6 

6 

-30-6 + 84-48 


6+1 — 1 + 0 
6 

-4+3+1+0 

6 

— 2 + 2 + () + 0 
6 

52 + 16-152-1-84 


6 

— 90 — 3 + 21 + 72 
(i 

60 — 9 — 21 — 24 
6 

30-6 + 0-24 
6 


6 

156 + 8-38-126 
6 

-104 + 24 + 38 + 42 
6 

— 52+ 16 + 0 -[-42 
6 


’1 0 0 O' 
0 10 0 
0 0 10 
.0 0 0 1 _ 


= /. ▲ 


If the order of the matrix A is high, then this method 
of inversion of a matrix is very laborious. There are other 
methods of inversion of a matrix which wo shall consider 
later on. 

It is very significant to find the inverse matrix A~^ 
for solving systems of linear equations. 
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2.5. Solving Matrix Equations 

We shall consider tliree kinds of matrix equations 


AX=--B, 

(1) 

XA ----- B, 

(2) 

AXB^C, 

(3) 


where 



are specified square malrices of the same dimension, and 



is a square matrix of the same dimension wlioso elements 
are unknown. 

Let us solve each of the equations (t)-(3). 

To solve equation (1), we premultiply two its sides hy 
A~^ (on the assumption that the inverse matii v 
exists): 

^-1 AX = A-^Ii. 

But the product A"^ A == 1 and, consequently, IX = 
whence 

X - A-^B, (4) 

Example 1. Solve the matrix equation 



A 


A (1) detyl-| ^'-23=^0. 


B 
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We seek A Since i4i 


iollows that 


9 , - 4.21 -^12 1»-422 — 2 , 


[: i] 


whfinco A 


1 I 0 -5n 

~2^li 2j- 


(3) From formula (4) we find that 


fn practical calculations wo often oncoiiiiter equations 
of torm (1), where x and b are voclor columns of tlie same 
dimension as the matrix A. 


Example 2. Solve the matrix equation 



A X I) 


1 1 2 

A ( 1 ) det/l- 2 -1 2 == --4 t -8 + 4 -l-'S 2 - 8 --r, = 74 = 0 . 

4 1 4 

(2) We seek A~^. We have - —0, A,^i • —2, A^j - 4, 
4 12 ~ A 22 ~ 4, /It 2 “ 4j.| - 0, A 2:1 ~ 3, A.^^ “ — 3, i.e, 



(3) From formula (4) we obtain 

r-1 -1/3 2/31 r -11 (- n 

x-X~ib=: 0-2/3 1/3 -4 ^ ^ A 

L 1 1/2 -I/ 2 J L - 2 J L- 2 J 

To solve equation (2), we postmnltiply its two sides 
by (on the assumption that the inverse matrix yl'"* 
exists): 

XAA-^ --= BA-K 

This means that XJ — BA~^^ whence it follows that 

A' BA -K (5) 
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Example 3. Solve the matrix equation 


1 

1 

— 1 

6 

2 

-r 

2 

— 1 

1 

6 

1 

1 

1 

0 

ij 

.8 

— 1 

4 


A B 


A We find that 


det A = 


1 

1 - 

-1 






2 

— 1 

1 


-3, 4,1 = 

-1, 

•^31 

— li A^i — 0 

1 

0 

1 






-1. 

^22 = 

= 2. 

-^32 

- 3, 4,3 

= 1, 

-'123 = 

II 

CO 

CO 

11 

1 

r 

— 1 - 

-1 

i)' 


' 

1/3 

1/3 O' 

= 

— 1 

2 

-3 

. ^-» = 


1/3 

-2/3 1 . 

L 

1 

1 

— 3_ 


^ — 

1/3 

-1/3 1 


From formula (5) we obtain 


"6 

2 

— r 


6 

1 

1 


,8 

-1 

4 



1/3 1/3 0 

1/3 -2/3 1 


' 

’3 1 1' 

— 

2 1 2 


A 2 3_ 


To solve equation (3), we premultiply both its sides by 
and postmuitiply thorn by (on the assumption 
that the indicated inverse matrices exist). Then we ob- 
tain 

A-^AXBB-^ A-WB~\ or IXr = A-^CB - 

whence if follows that 

X = A'^CB-\ (6) 

Example 4. Solve the matrix equation 

ri -3 21 r3 1 ri r 8 -4 -41 

3 —4 0 X 2 1 2 L.-. 18 5 10 I 

12 —5 31 Ll 2 3j Li 7 -3 -ij 


A We seek 




■ — 12 —18 r X 1/4 —1/4' 

— 9 — 1 G , 1 —2 1 

— 7 —1 51 L--3/4 5/4 — 1/4_ 


&-0104 
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(we recommend the reader to carry out the calculations indepen- 
dently). Next we have 

[ -12 - 1 81 r 8-4 -41 r22 19 301 

-9 - 1 6 18 5 10 = 12 13 20 . 

-7 - 1 sj Li 7— 3 -ij 1.11 8 I 3 J 

Now we find from formula (6) that 

r22 19 301 r 1/4 1/4 -1/41 12 5 61 

X = A-^CB'^=\ 12 13 20 \\ 1 -2 1 = 1 2 5 . A 

Lll 8 13 1 L-3/4 5/4 -I/ 4 J Ll 3 2 J 


2.6. Triangular Matrices. Expansion of a Matrix in 
a Product of Two Triangular Matrices 


A square matrix is said to be triangular if the elements 
which are higher or lower than the principal diagonal are 
zero. If the elements which are higher than the principal 
diagonal are zero, then the matrix is a lower triangular^ 
or subdiagonal^ matrix. Such is, for example, the matrix 


^11 

0 

. 0 " 

^21 

^22 • 

. 0 

Jnl 

fyi2 • « 




Now if the elements which are lower than the principal 
diagonal are zero, then the matrix is an upper triangular, 
or super diagonal, matrix. Such is, for example, the matrix 




^11 ^12 
0 r^a 


0 0 


^in 

^ 2 n 


rnn 


The determinant of a triangular matrix is equal to the 
product of its diagonal elements. U T = Ittj] is a trian- 
gular matrix, then 

det 1 = ^11^22 • • • ^nn- 


The inverse of a norisingular triangular matrix is also 
a triangular matrix of the same dimension and structure. 
If square matrix 



dll ai2 

. . . ttiji 

A = 

<*21 ®22 

... aan 


-«iii «n» 

••• ®nn- 
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has nonzero diagonal minors (this is the name for the mi- 
nors of the determinant of the matrix which have the 
diagonal elements of the matrix on their principal dia- 
gonals), i.e. 




^11 ^12 
flji a22 


=f^0f det^^O, 


then it can be expanded in the product of two triangular 
matrices (the upper and the lower). This expansion is 
unique if nonzero values are preassigned to the diagonal 
elements of one of the triangular matrices (say, they are 
set equal to unity). 

Assume that 

A = CB, 


where C is a lower triangular matrix and B is an upper 
triangular matrix with diagonal elements equal to unity. 

Using a xvu'Th-ordcr matrix as an example, we shall 
obtain formulas which express the relationship between 
the elements of the matrices A, B and C: 


Oil ai 2 ai 3 ai 4 


0 

1 


1 bi 2 bi3 614 

^21 ^22 ®a8 

__ 

^21 ^22 0 


0 1 628 ^24 

^31 ^82 ®8S ^84 


^31 ^32 ^33 H 


0 0 1 634 

^42 ®48 ®44, 


C42 C43 C44^ 


^0 0 0 1 _ 


We multiply and then equate the resulting elements of 
the matrix CB to the respective elements of the i. atrix 
A: 


Cii = a^i, 

(1) 

C 21 = ^211 

(2) 

^31 “ ^31’ 

(3) 

11 

(4) 

^11^12 “ ^12» 

(5) 

^21^12 ^22 ^ ^22^ 

(6) 

^31^12 “H ^32 ~ ^32» 

(7) 

^41^12 + ^42 “ ^42» 

(8) 


(•J) 

^21^18 ”1“ ^22^23 ~ ^23i 

(10) 

^31^18 "1“ ^32^23 "1“ ^33 “ ^33» 

(11) 


5 * 
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^41^^13 "t“ ^*42^23 "f ^*43 ~ ^43i (12) 

^‘ 11^14 “ ^ 14 * ( 13 ) 

^*21^14 ^22^24 ~ ^24? (1^) 

^31^14 + ^32^24 + ~ ^34» (13) 

^ 41^^14 ^ 42^24 ^ 43^34 + ^44 = ^ 44 - ( 13 ) 


From equations (I)-(IO) we liiid the elements bu 
and Cij (i = 1, 2, 3, 4, jf = 1, 2, 3, 4) of the triangular 
rrritrices B and C in the following order: 

(I) the first column of the matrix C [formulas (1)- 

(4)1: 

^ = 1,2, 3, 4. 

(II) the first row of the matrix B [formulas (5), (9), 

(13) 1: 

bij = J ~ 2, 3, 4. 

(III) the second column of the matrix C [formulas (6), 
(7), (8)1: ' 

Ci2 ^/2 ^ 4, 

(IV) the second row of the matrix B [formulas (10), 

(14) 1: 

^2J ~ (^2J? ^2l^^ljf)^^22» / “ 3, 4. 

(V) the third column of the matrix C [formulas (11), 

( 12 ) 1 : ' 

^i3 ^i3 ^il^l3 ^12^^23’ ^ 4. 


(VI) the third row of the matrix B [formula (15)1: 

^^34 ~ (^34 ^31^^14 ^32^24)/^33- 

(VII) the fourth column of the matrix C [formula 
(16)1: 

C44 = a44 ^41^24 — ^^42^24 ^43^34' 

Scheme of Successive Determination of the Elements 
b^j and cij 


flu ai 2 fll 3 fli 4 


“cii 0 0 0 “ 


1 ^12 ^18 ^14 

®21 ^22 ®28 ®24 


Cal C22 0 0 


0 1 623 ^24 

®31 ^32 ®33 ®34 


C31 C22 C33 9 


0 0 1 634 

_^ 4 l ^42 ^43 ® 44 _ 


_^41 ^42 ^43 ^44 _ 


0 0 0 1 
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11 — ^11 

11 

= 613 — 

" ^13/^1 1» ^14 — 

21 ~ ^21 

^22 

^23 

K 

^ 

31 ^31 

^32 

^33 

^3-, 

41"^ ^41 

^42 

C/.3 

i '''' 


III V VII 


II 

IV 

VI 


The roman hgurcs at the arrows show the sequence in 
which the elements and bu must be found. In this 
expansion we first And the columns and then the rows. 

To simplify the calculations, it is more convenient to 
expand the matrix A in I he product of two triangular 
matrices C and B using Table 2.1 given beJow. 


Table 2.1 


«ii 

ai2 

^13 

•ni 

^21 

ai2 

fl23 

^24 

®31 

^32 

«33 

^31 

fl4l 


<^42 


<^'13 


flu 

(?11 ™ flu 

1 


bi^~- (i\^l c 

11 

^^4 -- 1/ ^ 

11 

ri 

to 

C22 

1 

^^23 

^24 

^31 = ^31 

^32 

^33 

1 

^34 


C41 = a^i 

C42 

^43 


1 


This table is composed as follow.- 
1. On the basis of the formulas indicated above, we 
write the elements of the lirsl coin inn of the matrix A 
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in the first column of the matrix C and the elements of 
the first row of the matrix divided by in the first 
row of the matrix B, 

2. The elements which are under the stepped line can 
be found as follows: we take the requisite element of the 
matrix A and subtract from it the product of the elements 
which are to the left in the same row and higher in the 
same column as the required element, and here we multi- 
ply the first element of the row by the first element of 
the column, the second element of the row by the second 
element of the column and so on. 

For example, C33 = ^33 — — ^32^23* 

3. When we calculate the elements which are above the 
stepped line, we do the same as we did in item 2 but di- 
vide the result by the diagonal element Ca {i = 2, 3) 
which is in the same row as the required element. 

For example ^ . 

^33 

By analogy we can expand a square matrix of any order 
n in the product of two triangular matrices. Somewhat 
higher we have indicated the rule of transformation of a 
matrix into the product of two triangular matrices for 
the case bn = 1. Now if Cn = f, then we must first cal- 
culate the elements of the rows of the matrix B using the 
formula 

• i- 1 

ft=l 

and then the elements of the columns of the matrix C 
using the formula 


c„= (18) 

We represented the matrix A as the product CB of two 
triangular matrices, where C is the lower and B is the 
upper triangular matrix. This order of the factors is not 
obligatory, however, i.e. we can represent the matrix 
A as the product BC and obtain similar formulas for 
the elements of the triangular matrices B and C. 
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Example. Expand the matrix 

" 12 3 V 

-12 4 -3 
2 4 5 -2 
- 4 3 2 1. 


in the product CB^ where 

1 ^12 ^13 ^14 

0 1 ^23 ^24 

0 0 1 &3, 

^00 0 1 _ 

A The solution is given in Table 2.2. 


Cii 0 0 0 

^21 ^22 ^ 

^31 ^32 ^83 ^ 

LCjt Cj.i Cji Ca_4. 


Table 2.2 


1 

2 

* 3 

4 

-1 

2 

4 

-3 

2 

4 

5 

-2 

4 

3 

2 

1 

1 

1 |=-2 

4- 

T = ^ 

-1 

11 

7 

T 

CM 

4-{-l)-3 7 


-3-(-l)-4 

1 

A 

4 4 

4 

2 

4-2-2 = 0 

5_2. 3-0-7=-! 
4 

1 

-2-2-4-o4 

4 

3-4-2= -5 

2-4.3-{-5).| 

5 

“ 4 

l-4.4-(-5) 

xio=-|- 

1 
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Verification: 



2.7. Inversion of a Matrix by Expanding It in 
a Product of Two Triangular Matrices 

It follows from the definition of the inverse matrix 
that if 

A = CB, (1) 

where all the matrices are nonsim>’ular, we can find the 
inverse matrix using the formula 

A-^ B-^C \ ( 2 ) 

□ To prove the validity of formula (2), wc perform 
the following transformations. 

We premultiply both sides of relation (1) by the matrix 

C-M = C-^CB, or C M = /?. (3) 

We premultiply both sides of relalion (3) by the matrix 

B-^C-^A = /?-!/?, or - /. (4) 

We postmultiply both sides of relation (4) by the matrix 
A-^: 

{B’-^C-'^)AA-^=^A-^, or yl"* B“iC-*. ■ 

In formula (2) the inverse matrix A~^ is expressed as 
the pro duct of the inverse matrices and C“^. How- 
ever, if the matrices and C are triangular, then, to calcu- 
late the matrix A~^, it is not necessary to invert the ma- 
trices B and C. 
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Let us (ierive formulas for calculating the elements of 
the inverse matrix A~^ using the example of a fourth- 
order matrix. We designate the elements of the matrix 
A~^ as aij and tlie elements of the inverse matrices 

and C~^ as and respectively. The matrices B and 

C arc of the same kind as those given in 2.0. We postmul- 
tiply relation (2) by the matrix C and premultiply it by 
the matrix B\ 

A-^C -= B-^C-^C, or A-^C - (5) 

BA~^ ^ BB~^C-\ or BA~^ - C-\ (G) 


Matrices ajul B~^ arc triangular malrices of the same 
kind as tlio matrices C and B. We write relations (5) 
and (6) as follows: 


"ail ^13 ail" 


~ c ,, 0 0 0 


1 P 12 P 13 P 14 

aai ajo a.,.. 


Col ^22 ^ 


^ 1 P23 P2I 

0^31 ^32 ^33 ^34 


^31 ^32 ^33 ^ 


0 0 1 P34 

^0^41 a42 a43 a44 ^ 


C 41 C 42 C43 C44^ 


0 0 0 1 


1 ^12 ^13 ^^4 


ail 0 C |2 0^-13 CX 14 


-yii 0 0 0 

0 1 ^23 ^21 


0^21 ^22 ^‘23 ^24 


7ji Y 22 

0 0 1 63 ^ 


^31 ^32 ^33 ^34 


73 1 732 733 

0 0 0 t 


a,!! a 12 a4g ccj,^ 


_7ll 7 i2 7i3 744. 


(«) 


We shall multiply only I he rows and columns the 
elements of whose ])ro(lucts in tlie matrices B~^ a.. * 
are equal lo zeros and unities respeclively. 

We first consider Ihe product A~^C — B~^: 


Pn 

= «n^’]i 

-f 

cc,„r.,j 

-[- 

a. 

13^’ 31 

1 

T' 

^1 C“n 

- 1, 

(9) 

P 21 

” a-jiCji 

-1- 

CX>22^ 21 

+ 

a 

23^*31 

-1 

CCo 1^41 

-0, 

(10) 

Pai 

11 

-1 

0^32^21 

-1- 

a 

33^31 

1- 

OC 34 C 41 

= 0, 

(11) 

p41 

— 0t4iCii 

+ 

^42^*21 

-] 

a 

43^31 

1- 

^44^41 

= 0, 

(12) 

P 22 

= ttai-O 

-1- 

GC 0 0 C 0 0 

H- 

a 

23^32 

-1 

OC 24 C 42 

- 1, 

(13) 

P 32 

= agi-O 

-1- 

OC 32^22 

1- 

a 

33^32 


^34^42 

- 0, 

(14) 

P 42 

= a„-0 

4- 

0^42^22 

-!- 

a, 

13^32 

+ 

^44^42 

=--0, 

(15) 


P 33 — 0 ^ 31*0 0^32’^ I ^ 33^33 

P 43 = ^4 3^33 H“ ^44^43 ~ 

P 44 = a 4 i-t) + oCin-O + oCu-0 -|-a44C44 1. (18) 



74 


Computational Mathematics 


And now we consider the product BA~^ = C~^: 


Ti 2 

= 1 . 

ai 2 

+ 

612^22 

+ 

^13^32 

+ 

6140 X 42 

= 0 , 

(19) 

Yi3 

= 1 - 

ai3 

+ 

6120^23 

+ 

^ 130^33 

4- 

^14^43 

= 0 , 

( 20 ) 

Ti4 

= 1 . 

•ai4 

+ 

^12 ^24 " 1 “ 

^13^34 

+ 

6140 X 44 

- 0 , 

( 21 ) 

Tas 

= 0 

■“13 

+ 

1 ’0^23 

+ 

^23^33 

+ 

624 ^X 43 

= 0 , 

( 22 ) 

Y 24 

= 0 

•ai4 

+ 

l.a24 


^2 3^34 

+ 

624 CX 44 

= 0, 

(23) 

Y.i( 

= 0 

•®14 

J- 

1 

0 • CX 24 

+ 

l*a34 

+ 

6 34 a 4 4 

= 0. 

(24) 


We have to lind 10 unknown olernenls from rela- 
tions (9)-(24). We have 


I . 0^44 — 1/^44 

^•43 (1/^33) ( ^^44^43) 

0^42 — (1/^22) ( ^43^32 ^44^42) 

(1/Cij) ( 0^420.2^ 0^43^31 — 0^44^4l) 

II. a34--634a44 

0^24 “ ^23^^34 ^24^44 

^14 “ ^12^24 ^13^34 ^^4^44 

III. a33 -- ( 1 /C33) (1 0^34^43) 

^32 “ {^1^22) ( ^33^32 ^^34^42) 

^31 =-= (l/^ll) ( ®^32^21 ^33^31 ^34^4l) 

IV. 0^23 — ^23^33 ^24^43 

®^13 “ ^12®^23 ^13^^33 ^14^43 


[from (18)1 
[from (17)] 
[from (15)] 
[from ( 12 )] 

[from (24)] 
(from (23)] 
[from ( 21 )] 

[from (16)] 
[from (14)] 
[from ( 11 )] 

[from ( 22 )] 
[from ( 20 )] 


V. a 22 = (l/c 22 )(l — a23C32 — 024042 ) [from (13)] 

“21 (1/Cll) ( — ^Z2<^Zi — * 23^31 — “24^41) f from (10)1 

VI. ai 2 -- — fci 2«22 — ^ 3 « 32 — ^ 4*42 [from(19)] 

VII. aa = (l/cn)(l — ai 2 C 2 , — aigCg, — a, 4 C 4 i) [from(9)] 

Using the relations obtained at stages I-VII, we arrive 
the following scheme. 
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Scheme of Successive Calculations of the Elements 
of an Inverse Matrix 

VI IV II 

0^11 ^12 t t 0^14 

VII ^ 

0^21 ^22 ^ 2 Z ^24 

V^ 

0^31 ®32 ^33 ®^34 

III ^ 

^41 ^42 ^43 ^44 

I 


Using this scheme, wo can calculate the inverse matrix 
A~^ of the matrix A of any order if it is expanded in the 
product CB of two triangular matrices, where C and B are 
triangular matrices of the same kind as those presented 
above. 

This expansion results in the following formulas for 
the elements of the matrix A~^\ 


au=- S b,„a„,(i<j), 










^77 


( 25 ) 


Example. Using the expansion of the matrix 

'3 -2 2 0 " 

_ 2 1 1—2 

3-12 1 
A 2 —1 —1 

in the product of two triangular matrices, fmd the inverse matrix 
A-K 

A We compile Table 2.3 (see p. 76). 

We calculate the elements of the inverse matrix in the 
consecutive order indicated above (seethe scheme), using formu- 
las (25), 
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Table 2.3 



Ch. 2. Matrix Algebra and the Theory of Linear Vector Spaces 77 


I. a«4 = l/c,4 = l/18, 

_ « 44 g 4 » _ (l/18)-(-9/7) 1 

C 3 S 1/7 2 ’ 

«43C32-|-«44C4ii {l/_2) • 1 + ( ! '18) • (8/3) 





(X>42= — 


7/3 


18 ’ 


^41 


— 0^42^21 h 0^43^31 ~t~ 0^44^41 

Cll 


__ (-5/18) -2 + (1/2) . 3-K1/18). 1 
3 

II. 0^34= — &340t44~~ — 13/18, 

^24= -“(&23a34 + &24a44) 


[■(-— 1 

1 . 1 

131 

1 \-i 

G \ 

1 1 

L\ 7 j 

} \ 

"isi 

' 1 1 

7 J 

' 18 J 


CCu— — (^12^524 4~^1 s0^34 + ^J4^44) 




^32 


— 0^33^32 ~l~ 0^34^42 


(1/2). l + (- 13/18). (8/3) _ 11 


*31 


C 22 7/3 

0^32^21 + 0^33^31 + <^34^4 1 
^11 

( ll/18).2 + (l/2).3-|-(-13/18).l ^ 12 

3 18 ‘ 

IV. a23^ — (&23a33 + ^24a43) 

0^13““ ~~ (^12^23 4' ^13^33 “h ^14^^43) 

1 

V. a22 = — [1 — (a23';s2 4 «24C42) 1 

^22 


18 * 


7/3 

^ _ 0^22^21 + a23<?Sl + 0^24^41 

(^21= — 

__ (5/18).2 + (l/2).3+(-l/18)»l 


18 


i2 

'18* 
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VI. 


CLi 2 — (^120^22 ^13^^32 4“ ^14^42) 

5 . 2 11 


( “"f ) ’ i+T* * il+ ^ • ( “if) ] = “ 


18 


VII. aii = — [1— (012^21 + ai2C8i+ai4C4i)] 


Answer: A 


il‘ 


1 

18 


6 —4 
-12 5 

-12 11 
L -6 -5 


2.8. Step Matrices and Operations Involving Them 


When calculating liigher-order matrices, it is expe- 
dient to partition them into blocks by means of horizon- 
tal and vertical lines. Thus we divide every matrix into 
matrices of lower orders which are much simpler to cal- 
culate. 

A matrix partitioned into blocks is called a step mat- 
rix or a hypermatrix. 

For example, (1) matrix A is partitioned into four 
blocks 


A=- 


' ^12 
^21 ^22 
®8l ^32 
. ^41 <*42 


<*18 <*14 1 

<*28 <*24 _ f ylll I -^12 1 

<*88 <*84 L “<^21 I ^22 J * 

<*43 <*44 - 


which are square matrices 



(2) the wth-order matrix C is partitioned into four 
blocks 


r Cn-I 

Un -1 “1 

L yn-i 

^nn J 


where is a square matrix of order w — 1, is a 
vector column of order n — 1, v„_.i is a vector row of 
order » — 1, and Cnn is a scalar. 



Ch. 2. Matrix Algebra and the Theory of Linear Vector Spaces 79 


Such a partitioning into blocks is known as bordering 
of a matrix and a matrix is said to be bordered. 

We can add and multiply step ina trices manipulating 
the blocks of a step matrix as the elements of an ordinary 
matrix. 

Assume that 

are step matrices of the same order and partitioning. Then 
A + B 



- di 2 |-^12 

L 

-^22 + ^22 - 


AB 



A ^' iB 22 n 

L ^ 21^11 + ^ 22^21 

*^ 21^12 + -^ 22^22 J 


Example 1 Partition the matrices 


A = 


'5 7 -3 -4' 
7 6—4—5 

and 5 = 

T 2 3 4’ 
2 3 4 5 

6 4-3-2 

13 5 7 

.8 5 —6 — 1- 


-2 4 6 8- 


into square blocks and calculate A B and AB. 

A (11 We partition the matrices A and B into square blocks as 
follows: 



'5 7 

-3 

-4' 

r A^ 1 __ 

7 6 

-4 

-5 

^-^21 1 •^ 22-1 

6 4 

-3 

...o 


.8 5 

-6 

-1- 


"1 2 

3 4' 



2 3 

4 5 


L ^21 I ^22 J 

1 3 

5 7 



-2 4 

6 8- 



(2) We find that 


4+B=[ 


A\\ + ^11 1 Aia + ^12 


*^21 + ^21 I ^22 + ^2 


]= 


r 6 9 

0 0-j 

9 9 

0 0 

7 7 

2 5 

-10 9 

0 7- 


(3) We have 


r >iii^ii+ -^ 12^21 

-^11^12 + “^12^22 1 

Li42i5ii + A^^B^i 

-^21^12 + -^22^22 J 
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We find in succession that 


A-t-tB 


[-5 71 ri 2-(_ri9 31-] 

17 6J 12 3j“Ll9 32 J ’ 

AA."[i6 [isiS' 

-^21^11 + *^22^21 — [^^0 gj » 

[sa. 

-<4ii5i 2 + -^12^22 ~ 5 l()J *» 

V==[=? :?] [e s] -[I3I =a • 

-^21^12 + ^22^22= l^g yj . 


Thus 


' 8 6 

4 

2 " 

5 0 

-5 

— 10 

7 7 

7 

7 

-10 9 

8 

7- 


Assume that 



^^1 and 

®nn J L *n-i 


yn-l 1 

bnn J’ 


are bordered step matrices of order n and of the same par 
titioning. Then 


A+5= [ 


r -^n-i + ^n-i 

Un-i + yn-i 1 

L Vji.i + Xn-i 

®n7i + ^nn J 
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where -| is a square matrix of order n — 1 , 

Un-i + yn-1 is a vector column of order n — 1 , 

Vn-i + is a vector row of order n — i, 
dnn + ^nn scalars; 

^ ^ „ r + Un-I^n-I -^n-iyn-i r ^n-i^nn "I 

L '^n-lBn-l~\~^nn^n-l ^n-iyn-i~\~ ^nn^nn J* 


wliere is a square malrix of order 

//. -1, 


^^7j-iyn-i + a voclor coliimii of order n — 1 , 

v,,_i/)\,_i 1 - is a veclor row of order n — 1 , 
V;,-iyn-i V ^ro scalars. 

Example 2. Partition the matrices 



5 8 --4' 


3 2 5' 

A- 

6 \) —5 

and /? — 

4—13 


4 7 — 3_ 


^9 fi 5 


into blocLo bj .uMans of bordering and calculate A -\- B and AB. 
A (1) We partition the matrices A and B by means of bordering: 



5 8 
0 9 

, .4 - 

-5 


3 2 

4 -1 

5 

3 


4 7 

— 3 ^ 

L V2 1 <133 J 

J) 6 

5 


(2) We find that 



A 


r^2 f ^2 Uj l-yj I 
Lvj-f-Xa ajj + bjsJ 


8 

10 

r 

10 

8 

—2 

.13 

13 

2J 


(3) Wt' liavo 


r /IjBj + UjX, 
LvJB2^- 0,3X2 


^2y2+«2»33‘| 
V2y2-|-a33&33J ■ 


Wc find in succession that 


«^* 2 =[l 5 ] [9 IgJ] • 

yljfij !-U2X3=[“ Z27] ’ 

«2f'33=-[Z5] ^"=[-25]’ 'l3yi! + “a''3S--= 



6-01U4 
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V, 5,-14 7] _i] = I4'> 11, «.sX2 = (-3).I9 6] = I-27-18), 

V2^2 + fl88*2= 1^3 — 17], 

V 2 y 2=14 7] [ I ]=41, a, 363 , = (-3).5=-15. 


Thus 


Vay2 + a,3«»3., 

= 26. 

11 

-22 

29' 


9 

—27 

32 

• A 

13 

-17 

26_ 



2.9. Inversion of a Matrix by Partitioning It 
into Blocks 


To find ail inverse matrix, we can use the method 
of partitioning into blocks. Let A is s 

nonsingular step matrix of order n in which An and .4,2 
are square blocks of orders p and q (where p + 9 = n). 

We have to find the inverse matrix 

Lr>21 "22 J 

in which Bn and B 22 are square matrices of orders p 
and q too. 

According to the definition of the inverse matrix, 
AA~^ = In. In this case, the identity matrix will also 
be partitidned into blocks in the same way, i.e. /„ = 

[o^/J’ ^ 

orders p and q respectively. Then 


and Iq are] identity matrices of 


Bti ^22 J L -^22 J 


r ^ 1* 

^21 "22 J L -«11 -«22 J LO Iq J’ 

whence, after multiplication, we get four matrix equa- 
tions 

^11^11 + ^12-^21 “ ^p* 

^H-^12 + ^ 12^22 ~ 0» 

^2i^li "1" ‘®22'^21 “ 

lZ?2i-^12”l" ^ 22^22 ~ ^ Q‘ 

To find the blocks of the matrix we have to solve 
the system of matrix equations (1). To do this, we use 


( 1 ) 
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the method of elimination of the unknowns. We postmul- 
tiply the first equation of system (1) by and sub- 

tract the second equation of the system from the result of 
the multiplication. We obtain 

^12 (^ 21 ^iMi 2 — ^22) ~ 

From this we find that 

H,, = -Al[A,^ {A,, -A,,A;lA,,)-\ 

fill = A^^ ^^12^21^11* 

Similarly, we find from tlie third and fourth equations 
of tlie system that 

^22 (“^22 -^21^11^12) 

fi2i =- fi22^^21^It- 

This is possible under tlie condition that the requisite 
operations have sense. We introduce the following desig- 
nations: 

X = A^lAi2i y = 

® “ -^22 '‘‘^ 21 *^ ~ “422 — y -^ 12 ^ 

Tlien the formulas for the blocks of the inverse matrix 
A^^ can he written in the following form: 

fin + X0-W, fi ,2 - X0-i, 

fi^i - -^0-iy, B22-Q-^. (2) 

Formulas (2) are valid provided that and 0“^ 
exist. It is convenient to make Ihe following schen for 
calculations: 



A 21 



>»r.‘ 

Ai2 

0-1 


0 = A 22 — ^ -^12 


The inverse matrix has the form 



1 — 

CD 

1 

L — e-‘y 

e-‘ J 
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Example 1. By means of partitioning into blocks, invert the 
matrix 


A 

" 1 0 
— 1 2 

1 2" 

3 1 

A = 

4 0 

-2 1 


- 0 2 

1 2- 

r 

1 21 



.3 l] ’ 

^21 ~ 1 


A We designate 

and make the necessary calculations: 

det Aii = 2y l] ’ 


[r;]. 
jj-ir,’] [“]-[ 


-6 

-3 


"]■ 




We write the initial data and the results of the calculations in the 
form of the following table: 


• 



~ 2 lA 3j 



5 

“1 

1 

-J 


ll 

I I 

CO o 

I I 

151-3 6j 

^-Li ij 


Then we have 


p 

1 r 

1 


1 r 

-10 

10-| 

[4 3 J 

■ 15 L 

-3 

ej 

30 L 

-5 

-loj 


30 L -5 -loj Ll ij 30 L-30 -loj ’ 
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15 L-3 6j Ll ir 15 I -f. fi 

„__i_r2 4i _Lr-3 ~n_j_r‘-3o lo-i 
2 I 4 3j‘ 15 1 — 6 6,j 30 L — 30 — loj 


To ensure the correctness of the result, we have used two techniques 
to calculate the product X0-iy: = (X0-i) yandX0-iy= 

X (0-iy).| 

The final result is 


r Arf +x0-iy -x0-in 

L_0-iy 0-1 J 


r ^ 


^ r 

10 

-1 

30 

L-15 5j 

30 1 

5 


1 

r 3 ^1 

1 r 

1 

— 

- 15 

■[-6 ej" 

15 L- 

-3 



0 10 

10 

— 

10" 

1 

-15 5 

5 


10 

30 

0 14 

2 


14 


- 12 —12 

-6 


12 


The method of successive bordering is a special case 
of the method of inversion of step matrices. 

Assume that we are given a nonsingular square mat- 
rix of order n 



All ai2 .. 

• ^in 


^21 ^22 

• ®2n 


®nj ®n2 • 

. . ajiji 1 


for which we have to find the inverse matrix A 
We compose the succession of mal rices: 
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and so on. Each successive matrix is obtained from the 
preceding one by means of bordering. 

The inverse of the second matrix A~^ = can be 
found in a direct way: 

J-l D _ r ®22/l‘d2l ®12/M2l 1 

2 ^2“L flii/Mal J’ 

where 


M 2 


^11 ^12 
^21 ^22 




12 “' 21 * 


Using the matrix ^4;* and applying to the scheme 
for calculation presented above, we can get ^ 43 *, then 
using i4g‘, we can similarly get^”*, ... , and finally get 
An^ 


Example 2, Using the method of successive bordering, invert 
the matrix 

3 —4 5 0“ 

2-3 11 

^“3-5-12 • 

-3 -1 4 1- 


A We have 


r-3 -4 

5 

0- 

2 -3 

1 

1 

1 

CO 

-1 

2 

13-1 

4 

1. 


(1) Aii= _3] , det .4,= -9+8= -1, 
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(2) The scheme for calculating ^ 3 *= has the following form: 



[<*3i®3al 

^®33 

X 



C:] 


B -1 

Y 

0 


We carry out the calculations 

y-Ki a,jMi' = [3 -51 [2 

31 [ J ]= -1 + 2-f, 

0-1 = 1, xe-iy=[“].i.l-i 31=["^7 21] • 

Then we fill in the table: 



3 -5 

—1 

11 

CO 

1 

5 

7 

2 -3 

1 

1 

CO 

1 


We obtain the elements of the inverse matrix ^ 3 *= C<^ after 
making the following matrix additions and multiplications: 

= IC 31 C32i=-e-iy=[i -3], 
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Thus 

[ — 8 29 —11' 

-5 18 -7 . 

1 —3 1. 

(3) To calculate — — we compile a table: 



[^41^42^43] 

®44 

X 

AV 

®24 

L^34 J 

0-1 

Y 

0 


Then we carry out the calculations: 


y= 



29~inroi f 71 

— 8 29 —in 

-5 18 —7 =[-15 57 

1-3 1 J 


- 22 ], 


0 = 1 — [ — 15 57 


- 22 ] 



= 1 — 13 = - 12 , 


0 - 1 = - 1 / 12 . 


We fill in the table: 



3 

—1 

4 

1 

7 

—8 

29 

11 

0 

4 

—5 

18 

—7 

1 

—1 

1 

—3 

1 

2 

—1/12 

—15 

i 

57 

—22 

—12 
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Then we have 


^44 I 1 ^ 41 ^ 42 ^ 43 ] — 


1 

12 


[-15 57 ~22], 



The method of bordering can only be used if all the 
intermediate matrices / 1 2 , ^ 3 , . . nonsingu- 

lar. 


2.10. The Absolute Value and the Norm of a Matrix 

The absolute value {modulus) of the matrix A == [a,;] 
is a matrix | yl | = [ | a,*; | ], whore all the elements 

I a^j 1 are tlic moduli of the elemenls of the matrix A. 

Let A and 13 he matrices for which the operations 
A + B and AB have sense. Then 
(1°) \ A +B \^\A \+ \ B I 
(2^) \ AB \ <\ A \ B U 
(3°) |ayl| — I a I • \ A | , where a is a scalar. 

Tlie norm of the matrix A = laij] is a real number 

II ^ II » which satisfies the following conditions: 

(1®) II 11^ 0 (with II >1 II = 0 if and only if ^ = 0), 
(2®) II aA II = I a I • 11 A II , whero a is a scalar 
(with II -A II = IM II ). 

(3®) \\A +B\\^\\A ll + J]Bii, 
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(4-) II ^5|| <|M ||.|| 5||, 

(5°) IM ||> I II 5 II - lU II I where A and B 
are matrices for which the corresponding operations have 
sense. 

Let us consider the following three norms, which are 
easy to calculate, for the matrix A = [a/j] of an arbitra- 
ry dimension: 


II ^ II 1 = max 2 \ \ is the maximum sum of the 

^ j 

moduli of the elements of the matrix by rows, 

\\ A II 2 = V \ atj \ is the maximum sum of the mo- 

^ i 

dull of the elements of the matrix by the columns, 

IM II 3 = is the square root of the sum of 

ij 

the squares of the moduli of all the elements of the matrix. 


Example 1. For the matrix 



calculate || A ||i, || A Hg and || A II 3 . 

A We find that 

||.4||i = max(2 + l + 4, 5 + 3H-2, 6 + 7 + 3) = max (7, 10, 16) = 16, 
IMII2- max (2 + 5 + 6, 1 + 3 + 7, 4 + 2 + 3) = max (13, 11, 9) = 13, 
iM|l3=l/'22+ 12 + 42 + 52 + 32 + 22 + 62 + 72 + 3*^= /iM=12.2.^ 


For the vector x== 




these 


norms 


can be calcu- 


Larn-* 


lated by the following formulas: 

II X II 1 = max \Xi I is the coordinate of the vector 
maximum in its absolute value, 

II X II 2 = 1^1 I + I a:a I + . . . + I 1 is the sum of 
the moduli of the coordinates of the vector, 

II X II 3 <= Y I a;i I * + I Xj |2 + . . . + I a;„ 12 is the 
square root of the sum of the squares of the moduli of the coor- 
dinates of the vector. 

The norm |] x || 3 is the absolute value of the vector. 
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Example 2. For the vector X = ^ calculate || x ||i, llxHj 

, L-5 J 

and ||x||s, 

A We have 

||x||i = ma x(l. 2, 3, 5) = 5 . » Xj || = l + 2+3+5=ll. 
l|x|l3=l^l» + 2*+3* + 5* =/39 = 6,2. A 

2.11. The Rank of a Matrix and the Methods of Its 
Calculation 

Consider a rectangular matrix 



r fill 

ai2 •• 

• ®171 

A = 

^21 

^22 * 

• ®2n 


_ ^mi 

®m2 • • 

' • ^mn _ 


If we choose k arbitrary rows and k arbitrary columns in 
this matrix, where k ^ min (m, n), then the elements, 
which are at the intersections of these rows and columns, 
form a square matrix of order k whose determinant is a 
/cth-order minor of the matrix A, 

For instance, the intersection of the first and second 
rows with the first and second columns of the matrix 

A is occupied by a second-order matrix whose 

determinant is a second-order minor of the matrix A. 
We designate it as 

= . 

* 1 «ai “82 

The rank of the matrix A is the maximum order of the 
nonzero minor of this matrix. It follows from the defini- 
tion of the rank that if the rank of a matrix is r, then there 
Is at least one nonzero minor of order r in the matrix 
and all the minors of order r -|- 1 and of higher orders are 
zero. Note that the rank of a zero matrix is zero and that 
of a nonzero row matrix (or column matrix) is equal to 
unity. 

For a rectangular matrix of dimension m X n the 
difference of the least of the numbers m and n and the 
rank of the matrix is known as the deficiency of the matrix. 
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For an ji X n square matrix the deficiency is equal to 
n — r. If the deficiency is zero, then the rank of the mat- 
rix is the greatest of the possible ranks for that dimen- 
sion. 

Let us consider one of the methods of calculating the 
rank of a matrix based on the definition of the rank. 
In this case it is necessary to find the minor of the max- 
imum order different from zero. When using this me- 
thod ^o calculate the rank of a matrix, we pass from mi- 
nors of lower orders (beginning with the minors of the 
first order, i.e. the elements of the matrix) to the minors 
of Iiigher orders, carrying out the operations according 
to the following rule: assume that we have found tlie 
rlh-order minor Mr, different from zero; then we have 
only to calculate the minors of order r + 1 which border 
the minor Mr- If all these minors are zero, then tlie rank 
of the matrix is r, but if at least one of them is nonzero, 
then the operation must involve that minor, and in that 
case tlie rank of the matrix is obviously higher than r. 
This method of calculation is known as the method of 
bordering. 

Example 1. Using the method of bordering, find the rank of 
the matrix 

0 " 

0 
1 

2 . 

A (1) We choose a first-order minor which is nonzero: Ml = 
^22 = ^ = 7 ^ 0 (the upper index is for the ordinal number in the 
calculation and the lower index is for the order of the minor). 

(2 We find the second-order bordering minor which is nonzero: 

"* = [-2 

(3) We consider all third-order minors which border the minor 
Af|, for which purpose wo compose minors MJ and from the 
second, the third and the fourth row: 



2 4 1 


4 1 0 

A/J = 

— 1 -2 3 
0 0 7 

= 0, Ml = 

—2 3 1 

0 7 2 


since in these minors the third row is equal to the sum of the first 
row and the doubled second row. 


A = 


2 4 1 

2 4 i 

-1-2 3 
0 0 7 
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The bordering minors from the first, the second and the third 
row are also equal to zero since the first and the second rows are 
identical. If all the third-order minors are zero, then all the higher- 
order minors (beginning with 3 1- 1 ^ 4) are also zero. Conse- 
quently, the rank of the matrix is 2 and the deficiency 4—2 = 2 . ^ 

Since the number of determinants of different orders, 
generated by the matrix, is usually large, the calcula- 
tion of the rank by the method of bordering is very la- 
borious. 

It is much simpler to calculate tlie rank by means of 
elementary transformations of the matrix. 

The elementary transformations are 

(1) permutation of two rows (columns), 

(2) multiplication of a row (column) by a number 
k {k •=jf=- 0), 

(3) addition of a row, multiplied by a nonzero number 

/c, to row (column), 

(4) elimination of a row (column), consisting of zeros, 
from the matrix, 

(5) elimination of a row (column) which is a linear 
combination of other rows (columns) from a matrix. 

Elementary transformations do not change the rank 
of a matrix, i.e. transformations of this kind result in a 
new matrix which is not equal to the original one but is 
equivalent to it (the ranks of these matrices are equal). 
The symbol ^ is used to denote the equivalence of ma- 
trices. 

Transformations of a matrix can be carried oi ■ in the 
following order. 

1. If the element a^^ in the upper left corner of the ma- 
trix is zero and the matrix has nonzero elements, then by 
interchanging rows and columns we replace the zero ele- 
ment by one of the nonzero elements and, using elementa- 
ry transformations, turn all the other elements of the first 
row and all the elements of the first column into zeros. 
In what follows, the first column and the first row remain 
unchanged (we can only interchange them). If all the 
other elements of the transformed matrix are zero, the 
rank of the matrix is equal to unity, i.e. r = 1. 

2. If ^22 = 0 in the transformed talrix but there are 
nonzero elements, we can ])ut one of them at the inter- 
section of the second row and the second column and 
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apply elementary transformations to turn into zeros 
first all the other elements of the second row and then 
all the other elements of the second column and continue 
with the transformations in a similar way. 

As a result we can obtain a matrix whose elements are 
only unities which are on the principal diagona], the 
number of these elements being equal to the rank of the 
matrix, and whose other elements are zeros. 

Example 2. Using elementary transformations, determine the 
rank oi the matrix 


“ 1 2 3 

— r 

— 13 2 

0 

3 1 4 

— 2 

-—3 4 1 

1. 


A Let us carry out in succession the following elementary trans- 
formations of the matrix* 

(a) First we add the first column to the fourth and then, multi- 
plying in succession by (—2) and ( — 3), add the results to the second 
and the third column respectively. 

(b) We eliminate the second and the third column since they 
result from the fourth column after the multiplication by (—5). 

Then we have 



“ 123 -r 


r 1 0 0 O' 


" 1 O' 


-13 2 0 

3 14-2 

(fl) 

/%•/ 

-155 -1 
3—5—5 1 

(6) 

— 1 -1 

3 1 


-—3 4 1 1- 


\ 

1 

o 

CO 

1 


-—3 -2- 


It is evident that the rank of the last matrix is 2. It cannot be 
higher than 2 since if r = 2, then the deficiency is zero (n — - r = 0) 
and cannot be lower than 2 since the matrix has a minor ^ 0. 

The matrix obtained is equivalent to the matrix A and, con* 
sequently, r (A) = 2. 

We can arrive at the same result if we continue with the trans- 
formations of the matrix. 

(c) First we add the first row to the second and then, multi- 
plying it in succession by (—3) and 3, add the results to the third 
and the fourth row respectively.' 

(d) First we add the third row to the second and then, multi- 
plying it by 2, add the result to the fourth row. 

(e) We eliminate the zero rows. 

We have 




Ch. 2. Matrix Algebra and the Theory o( Linear Vector Spaces 95 


The last matrix docs not play the part of an identity matrix, 
it results from elementary transformations and is equivalent to 
the matrix A. The number of unities on the principal diagonal of 
the matrix obtained is 2. Consequently, r (^4) = 2. 


2.12. The Concept of a Linear (Vector) Space. 

The Linear Dependence of Vectors 

The linear {vector) space is the set U of elements x, 
y, z, .... for which the operations of addition of the 
elements and the multiplication of them by a real num- 
ber can be performed within the set U and which satisfy 
the following axioms: 

(1“) X + y = y 4- X, 

(2°) (x 4- y) + z = X + (y + z), 

(3°) there is an element 0 ^ Z7 such that x + 0 = x, 

(4°) for ^^very x there is an opposite element — x £ U 
such that X + ( — - x) = 0, 

/e;o\ /I „ 

(6“) a (Px) = (ap) X, 

(7°) (a 4- P) X = ax 4- px, 

(8°) a (x + y) = ax 4- ay, where x, y, x ^ U and a 

and p are real numbers. 

Note that 0 • x ~ 0 arid (—1) x = — x. 

Example 1. The set of all n-dimensional vectors with the ordin- 
ary operations of addition of vectors and multiplication of a vector 
by areal number a forms a linear space since those operations satisfy 
axioms l°-8°. 

The sum of two vectors x = (xj, and y ~ 

^21 • • •» yn) Is a vector z = x + y = (xj + x^ + ^ 2 * • • •» 
x,i + ^ 71 ^; the product of the vector x by the number a is a vector 
ax = (axi, axg, . . ., ax^) (see 2.1). The vector 0 = (0, 0, . . ., 0) 

is a null vector; the vector ~x = — Xg, . . is op- 

posite to the vector x. All the axioms of the linear space are 
evidently satisfied. 

Example 2. The set of vectors of different dimensions is not 
a linear space since the operation of addition is not defined for them. 

Example 3. It can be shown that square matrices of the same 
order form a linear space whereas square matrices of different 
orders do not form a linear space since the sum is not defined for 
them. 

The notion of linear dependence of vectors is of great 
importance in linear (vector) space. 

If Xi, Xg, . . x^ are vectors from the space U, then 
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n 

the vector z = CiX^ + C 2 X 2 + . . . + = S is 

1=1 

a linear combination of the vectors Xj. 

n 

If the vector z = 2 = 0 hut among the numbers 

i— 1 

Cl, Cg, . . there is at least one number different from 
zero, then the vectors are said to be linearly dependent. 
The veclors Xj, Xg, . . are linearly independent 

n 

if their linear combinalion z — 2 is equal to the 

i — 1 

zero vector if and only if all c^ — 0 (i = 1, 2, . . ., n). 

There are not more than two linearly independent vec- 
tors on the plane and not more than three linearly in- 
dependent veclors in the Lhree-dimonsional space. 

Theorem. If the vectors Xj, Xg, . . x^^, which belong 

to the linear space //, are linearly dependent, then at least 
one of them is a linear combination of the other ones. 

□ Since ihe vectors Xj, Xg, . . ., are linearly de- 
pendent, it follows that CiXi + CgXg Cn^n = » 

and at least one of the numbers c< (i = 1, 2, . . ., w) is 
nonzero. Let c^ ^ 0 {I ^ n). Tlien the vector X}^ is 

a linear combination of the vectors Xi, Xg, . . ., x/,_i, 

l» • • • > X^ . 


Ch-l 

Ch 







Xft+i - . . . — 



Example 4. Given a wsystem ol n w-dimonsional unit vectors 

ei = (L 0, 0, . . ., 0), 

eg = (0, L 0, . . 0), 

e„ = (0, 0, 0, . . ., 1) 

find out whether the system is linearly dependent. 

A (1) We form a linear combination of these vectors and equate 
it to zero: 

'i ^*2^2 + . . . H- ^^71©^ ~ 

(2) We write this relation in coordinates: 

ci'l + Cg-O-j- . . . -[-C71 •0 = 0, 

Cl *0 -f- Cg • 1 -h . . . + Cji • 0 = 0, 


Cl *0 -p Cg *0 -j- . . . Cji *1 — 0. 
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Hence Ci ~ ... = = 0. This means that a sys- 

tem of fi /i-dimensional unit vectors is linearly independent. It 
is evident that any part of this system of vectors is linearly inde- 
pendent cither. ^ 

Example 5. Given vectors = (1, 2, 3) and Xj = (3, 6, 7), 
find out whether these vectors are linearly dependent. 

A (1) We form a linear combination of tne vectors and equate 
it to zero; 


^1*1 + CaXa = 0. (*) 

(2) The vector equality (*) is eq^uivalent to the homogeneous 
system of three linear equations witn two unknowns 

1*Ci + 3C2 = ^L 

2ci + 6c2 = 0, (*♦) 

3ci + 7c2 = (). 

(3) We divide both sides of the second equation of system (>!>*) 
hy 2: 

f 1 • Cl -f- 3^2 = 0, 

< l*ci-j-3ca = (), (**♦) 

V, 3ci-f-7ca = 0, 

There are two identical equations in system (*♦*) one of which 
we deJete. 

(4) Solving now the system 

r 1 -Ci + 3c2 = 0, 

\ 3ci + 7c2 = 0, 

we get Cl = 0 and Cj = 0. Thus the given system of vectors is 
linearly independent. ^ 

Example 6. Given vectors Xi ~ (1, 3), Xg = (0, 2), X3 — (5, 7), 
lind out whether this system of vectors is lint^arly depender , 

A (1) We form a linear combination of the vectors and oquate 
it to zero: 

CiXi + CjXa + C3X3 = 0, (•) 

We write relation (♦) in coordinates; 

r l.Ci+0.C3+5<ra=0, 

\ Scj-f- 2 c2“|-7c§=0, 

Wo have obtained a system of two linear equations with three 
unknowns. 

(2) We use the method of substitution to solve this system. We 
substitute the expression Ci = — 603, obtained from the first equa- 
tion, into the second equation: — IScg + 2c^ + 7c ^ =* 0. Hence 
Ca = 4C3. We assign an arbitrary nonzero numerical value to C3, 
say, C3 = 1. Then = — 5 and = 4. 

(3) We substitute these values into relation (•): 

— 5xi + 4Xa -1- Xs = 0, or Xg = fiXg — 4xa, 


7-0104 
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i.e. thp vector is a linear combination of the vectors and Xjj, 
and this means that the vectors Xj, Xg and x^ are linearly depen- 
dent. 

2.13. The Basis of Space 

The linear (vector) space U is said to be n-dimensional 
if there are n linearly independent vectors in it and there 
are no more linearly independent vectors. The number n 
is the dimension of the space and the space itself is finite- 
dimensional (designated as Uj^). 

If there is an arbitrary numW of linearly independent 
vectors in the space U, then the space is infiinite-dimen- 
sional. 

Any set of n linearly independent vectors of /i-dimen- 
sional space is the basis of that space. 

In every space there is an inlinile set of bases. One of 
them is a . system of unit vectors: 

e, = (l, 0, 0, 0), 

G 2 — (0, 1| 0» •••« 0), 

e„ = (0, 0, 0, 1). 

Theorem 1. Every vector of an n-dimensional space 
Uj^ can be represented as a linear combination of the vectors 
of the basis, and that representation is unique, 

□ Let X ^ Uji and ei, eg, . . e^x be the basis of the 
space Un- The vectors x, ei, eg, . . ., e^i are linearly 
dependent (their number is -f- 1 exceeds the dimen- 
sion of the space), i.e. 

CoX + CiCj + CjCa + . . . + c„e„ = 0, (1) 

where a certain coefficient cj^O (0^/^ra). In rela- 
tion (1) tlie coefficient Cq ^0 since otherwise 

CjGi -f- C2e2 “h • • • “1” Cj|e„ = 0, 

where cj =^^0 (/^ 1), and this contradicts the linear in- 
dependence of the vectors Gj, Gj, . . e„. Consequently, 

relation (1) can be solved for x: 

* = Yiei + Yae2+---+Ynen. (2) 

where Vi = Ya = — ^aCo. • • m Yn = 
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Thus t^ny vector x of the space f/„ is a linear combina- 
tion of the base vectors. 

We shall prove that representation (2) is unique. We 
assume that there is another representation 

X = + , . . + Y;e^, (2') 

different from representation (2). Subtracting (2') from 
(2), we obtain 

0 -= (Yi ~ Yi) Ci + (Ya — Ya) Ca - • • • — (Yn — Y») «« • (•^) 

Since the base vectors e^, Cg, . . are linearly inde* 

pendent, there must hold reJations 

(Yi — Yi) = 0. (Ya — Yi) = 0, . . (Yn — Yn) = 

whence it follows that Yi ~ Yi» Y 2 = V 2 » • • •» Yn 
Yh, i.e. representation of the vector in terms of the 
base vectors is unique. ■ 

The numbers Yi» Y 2 » • • •» Yn in relation (2) are the 
coordinates of the vector x witJi respect to the basis e^, 

®2» • • •» ®n* 

Consider a system of m vectors in tlie ^-dimensional 
space 

Xi =- -f- ^2102 + . . . + 

X 2 ^ 12 ® i H ' ^^'22^2 • • * H~ 


Xm — ' ^im®l ^2m®2 “h • • • "t* ^nm®n* 

We write the matrix composed of the coordinates of these 
vectors so tliat the elements of the jlh column are equal 
to the coordinates of the /th vector (y ~ 1, 2, „ . m): 


f ^11 ^12 • • • ®im 
<*ai ®22 • • • ®2m 


\ ®ni ®ii2 • • • * 

Let the rank of this matrix be equal to r. Then the 
rth-order minor, different from zero, is a base minor 
of the matrix A, The rows and coluwins whose intersec- 
tion is occupied by the base minor are base rows and 
base columns. 


7* 
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Theorem 2 (on the base minor). The basic columns (rows) 
of the matrix A are linearly independent and every column 
{row) of this matrix is a linear combination of its base 
columns {rows). 

Example. Given a system of vectors = (—2, 4, 3, 5), 
Xa = (0, 1, 2, —1), x., = (—2, 7, 9, 2), we must find the linear 
dependence of this system of vectors, determine the basis of the 
system and represent the vectors of the system as a linear combi- 
nati n of the base vectors. 

A (1) We form a matrix from the coordinates of the vectors: 
"—2 0 — 2 ' 

3 2 9' 

-5—1 2- 


Then we determine the rank of the matrix A iisin^ the borderinjj 

I 2 0 

method. We take a minor consider the 

minor bordering it: 



— 2 0 —2 
4 1 7 

3 2 0 


To calculate this minor, we subtract the first column from the 
third and get 


— 2 0 0 
4 13=0 
3 2 6 


since there are two proportional columns. 
The second bordering minor 



since, after a similar transformation, it also contains two pro- 
portional columns. 

Thus all minors uf the order higher than the second are zero and 
therefore the rank of the matrix >4 is 2 and the minor = 


—2 0 
4 1 


is a base minor. Gonsequentl> , the vectors x^ and X2 


are linearly independent and form the basis of the system and the 
vector X3 is their linear combination. Thus this system of vectors 
is linearly dependent. 

(2) We set up an equality 


CjXi + cax.^ + €3X3 = 0, 


(•> 
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whence we get a system of equations 

/ Ci(~-2) + C 2.0 + c3(-2)-n, 

\ — 0 . 

We find the expression for = —c^ from the first equation and 
substitute it into the second equation: 

— 4^3 + Cj + 7^3 = 0, C2 = — Sfg. 

We set c., = 1 and then = — 1, Cg = — 3. Substituting the 
values of Cj, and into relation (♦), we get 

— + 3 x 2 + X 3 == 0, or X3 = X, + 3 x 2 - 

Thus the vector X 3 is represented as a linear combination of the 
base vectors Xj and Xg. This representation is unique. The numbers 
(1, 3) are the coordinates of the vector X 3 in the basis (Xj Xg). 


2.14. The Transformation of the Coordinates 
of a Vector upon a Change in the Basis 

Let (e) — fe,, Ca, , . e„) and {f} = (fj, fg, . . f^) 

be two bases of the same linear space Every vector 

of the new basis (f) has coordinates s.yj, . . s^^j 

in the old basis {e} and in the designation of the 
coordinates Su (i = i, 2, . , /?) tlie first index denotes 

llie number of tlie old base vector and llie second index 
denotes the number of the corresponding new base vec- 
tor. Consequently, 

f) ^ + •'>’2^e2 + - . • + SnjCn (/ = 1, 2, . . «), (1) 


or 


wh ere 


rfi = Siiei + ^2i<‘2 I ••• 
^ f2 - ^12^1 “b "’^22^2 4“ ••• 


fn“^iuCi b ^*271^2 t • • • 1 



" ^11 

*21 • 

• *711 

6 ’- 

*12 

*22 • 

• *712 


. *171 

*271 • 

» • *nn _ 


( 2 ) 


is a nonsingular matrix since det S ^ 0 (otherwise the 
rows of this matrix and, hence, the vectors f^, f.^, . . ., f^ 
would be linearly dependent). 

The matrix S is tlie matrix of the transformation of th^ 
old basis into a now one. 
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Let X be an arbitrary vector of the linear space 
being considered. We designate the coordinates of this 
vector in the old basis as Xi and its coordinates in the new 
basis as It is evident that 

X = + Vzh + • • • + VnK == + • • • + -c„e„, 

n n 

or x = 2] 3 : 46 , = S yjfj- 

j=i }=i 

n 

Taking relations (2) into account, we have ^ - 

;--i 

n 

S whence, substituting the expression for ijj we 

i=l 

n n n n n 

gel x-S = S Sijyj. (;^) 

2=1 ;-=l 2=1 i-—\ j — i 

Consequently, by virtue of the linear independence 
of the vectors e^, C 2 , ..., e^, wo find that 

n 

Says 2, n), 

i=i 


or 


^1 — ~f* •^2i//2d' ••• 

^2—^12^! d' ^221/2+ ••• +^n2l/ni 
+ ^2nl/2d” ••• 4"'^nnJ/7i* 


Relation (4) can be written in matrix form as 

X = Sy, 


( 4 ) 


( 5 ) 


i.e. in the old coordinates (in the old basis) the vector is 
equal to the transformation matrix S multiplied by the 
vector in the new coordinates. We premultiply relation 
(5) by the inverse matrix S~^\ 

S~^x = y» or y ~ S“^x. 


The matrix 5"^ has the form 




r Siild Sizld 

I *^'21/^ *^'22/*^ 


S\nld' 

S^nld 


L ^nild 5n2/d . • . Sjij^ld J 


(6 
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wliere d is the determinant of the matrix 5 (d ^ 0 since 
S is a nonsingular matrix) and s^j are cofactors of the ele 
ments of the determinant d. Then 


Ui = 


U2 ^ 


>11 


^1- 


^1- 


5]2 


d 
S 22 


■ ‘^2 "h • • • 

XaH -...- 


> In 


d 

^2n 




^n» 


( 7 ) 


.. _ ^ni ^ 
Un — 




Rclations (7) are formulas for transition from the coordi- 
nates Xi of the vector x in the old basis to tlie coordi- 
nates i/i in the new basis (i = 1, 2, . . The transition 
from the coordinates to the coordinates yi is carried out 
by means of the matrix S~^ which is the inverse of the 
matrix of ilie transformation of the old basis into a new 


one. 


Example. Find the coordinates of the vector x == (0, 0, 0, 1) 
ill the basis Cl — (1, 1, 0, 1), e.^ = (2, 1, 3, 1), c, = (1, 1, 0, 0), 
- ((b 1, -1, -1). , 

A (1) We compose a matrix S of the transformation of the old 
basis into the new one: 

[ 12 1 0^ 

111 1 
0 3 0 —1 • 

1 1 0 

(2) We find the inverse matrix 


We have 




11 

S21 

'S’31 

541I 


12 

S22 

*^32 

•^42 


13 

^23 

*^33 

*^43 

• 

14 

^24 

•^34 

544- 



det 5 — 


12 1 0 
111 1 
0 3 0 — 1 
110-1 
-1 1 
3 -1 


1 2 1 0 

0 —1 0 1 

0 3 0 —1 

1 10—1 


= - 2 . 



0 

-1 

1 

= 

0 

3 

— 1 


1 

1 

-1 


We have transformed the determinant the matrix 5 in the 
following way: first wo subtracted the first row from the second, 
1;hen expanded the determinant obtained according to the element^ 
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of the third column, and finally expanded the resulting determinant 
according to the elements of the first column. 

We calculate the cofactors: 


1 

1 

1 

11 

1 

1 

5ii= 3 

0 

-1 =2; 

*^12= ^ 

0 

— 1 

1 

0 

— 1 

|l 

0 

— 1 



1 

1 


1 


1 

1 

1 


0 

3 

— 

-1 

= 

0 

3 

-1 


1 

1 

- 

■ 1 


0 

0 

— 2 



1 

1 

1 

1 




Su- 

= — 

0 

1 

3 

1 

0 

0 


— 

0 3 
1 1 


2 1 0 

— 3 0—1 = 
1 0 —1 

110 
0 0—1 = — 
10—1 ' 

1 2 0 

— 0 3 —1 _:r 
1 1 —1 

112 11 


0 | 

-iL— I 


= - 3 . 


(the first row is equal to the sum of 
the second and the third row), 


0 1 1 

1 = — 0 0 


= -i. 


10 — 1 



1 2 0 


1 2 0 

<^33 — 

1 1 1 

= 

1 1 1 


1 1 —1 


2 2 0 


= - 0 -1 0 =_ 


1 =— 1 1 1 
— 1 4 10 


= - 2 . 
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1 1 0 

^4 2 — 11 1 —0 (there are two identical columns), 

0 0 —1 


1 

2 

0 

1 2 

0 



13 -- ■ 1 

1 

1 

- - 1 4 

0 

1 


0 

3 

-1 

0 3 

-1 

1 

41 


1 2 1 

^44 - 1 1 1 = 0 . 
o 3 0 

Consequeully, 

2 -2 n —2 

V-i J- 1—1—1 0 

2 —0 42 2 • 

3 -3 -1 (‘ 

(3) From formula (0) we find the coordinate's of llie vector x 
in the now basis: 
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3. Find the product XY if 


(a) X = 



2J 


y-li 2 


-3], (b) X = 


(c) X-:[10 17 8 5 11], 



4. Find the product AX if 



l.G 

5.4 

— 7.7 

— 3.1 

8.2 

1.4 

-2.3 

0.2 

5.3 

-5.0 

2.7 

-7.0 

0.7 

1.0 

-8.5 

4.8 


6. Calculate A for the following matrices: 



0 0 0 " 
2 0 0 
3 4 0 

2 —1 3- 



,y=l4 5], 
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7, Find AB^ where 


/I- 


’1 4 1 31 ri 1 1 r 

0 -1 3 -.1 1 4 2 3 

3 10 2 * 1 10 3 6 • 

-1 —2 5 IJ Le 10 1 4- 


using two techniques: (a) by partitioning A and B into square 
blocks, (b) by partitioning A and B into blocks by bordering. 

8. Calculate A'^ using the partitioning into blocks and border- 
ing if 



9. Expand the matrices given in Exercise 8 in the product of two 
triangular matrices and invert them using the expansion of matrices 
in the i)r()diict of two triangular matrices. 

10. Solve the following matrix equations: 


' 0 3 —11 r 7 6 —3" 

(a) X 2-1 2^-8 3 6 , 

^-3 1 ij _ 11 9 13 


^ 7 6 

— 3' 

“ — 3 

-10 

— 4" 

(b) -8 3 

6 X - 

21 

14 

-10 

11 9 

13 

48 

2 

30 


11. Calculate the ranks of the following matrices: 

"2 4 10-1 

~2 -1 3 -2 4] 2 4 10 

(a) /!=. 4 -2 5 17, (b) B= -i -2 3 1 | . 

[ 2-11 8 2 J 5 10 6 1 

L 9 07 2j 

12. Test the following systems of vectors for linear dependence; 

(a) X, = (5, 4, 3), Xa = (3, 3, 2), x., = ( 8 , 1, 3), (b) Xi = 

(1, 0, 0, 2, 5), Xa = (0, 1, 0, 3, 4), x., - (0, 0, 1, 4, 7), X 4 - 

(2. -3, 4, 11, 12). 

13. For the system of vectors Xj — (5, 2, —3, 1), x, -- 

(4, 1, —2, 3), X 3 = (1, 1, —1, — 2 ), X 4 = (3, 4, —1, 2) fincf the 

basis and express the other vectors in terms of the base vectors. 

14. Find the coordinates of the vector x = (1, 2, 1, 1) in the 
basis 01 = ( 1 , 1 , 1 , 1 ), 62 = ( 1 , 1 , — 1 , — 1 ), 03 = ( 1 , — 1 , 1 , 
-1), 04 - (1. -1, -1. 1). 



Chapter 3 


Solving Systems 
of Linear Equations 


3.1. Systems of Linear Equations 

In the general form a system of m linear equations in n 
unknowns is written as 


® 11^1 H' ^ 12 ^ 2 + • 

• • + • - 



'* 21^1 "h <^ 22^2 H" * 

..-]ra^)Xj -1- .. 



-f ^ 1 * 2^2 + • 

. . -f- aijXj + . 

• ' "I" » 

( 1 ) 

1^1 "1 ■ ^ 7712^2 "h • 

. .-\-ajnjXj-\- . 

• • d' ^mn^n — 



Tlie equations of the system are assumed to he enumerat- 
ed, i.e. the first, the second, . . the /nth. The numbers 
a’j, 2-2, , . Xn are the unknowns of the system and 
^i2» •• -1 ^mn ^ire the coefficients of the unknowns of 
the system. 

The coefficient of the unknown Xij in the ith equation 
is designated jis where the first index i indicates the 
number of the equation which contains this coefficient 
and the second index / indicates the number of the 
unknown in which this coefficient is. For instance, llie 
coefficient Oga in the second equation of tlic system in 
the unknown x^. 

The numbers b^, . . b^^ are constant, or free, 

terms of the system. 

In the abbreviated form system ( 1 ) can be written as 

s aijXj=-h, (i=-l, 2, m). (1') 

}=i 

A solution of the system of linear equations ( 1 ) is any 
set of numbers a^, cc„, wliicti, being siibsti 

tilted for the unknowns x^, x^y • . fhe equations 

of the system, turn all the eejuations into identities. 



Ch. 3. Solving Systems of Linear Equations 


109 


Tho systoiii of linear equations (1) is consistent if it has 
a solution. If a system of linear equations has no solu- 
tion, then it is inconsistent (or incompatible), 

A consistent system of linear equations may have one 
solution or several solutions and is said to be determinate 
if there is one solution and indeterminate if there are 
more than one solution. 

Two systems of linear equations with the same number 
of unknowns are equivalent if they arc either both incon- 
sistent or both consistent and have the same solutions. 

Hero arc three types of the elementary transformations of 
a system of linear equations: 

(1) permutation of two equations of the system, 

(2) multiplication of both sides of an equation of the 
system by any nonzero number, 

(3) addition to (subtraction from) both sides of one 
cquatioji oi iLc corresponding sides of anotlicr equation 
multiplied by any number. 

We can prove that elementary transformations turn a 
given system of equations into an equivalent system. To 
perform elementary transformations is the same as to 
express one unknown in terms of the others. 

A system in which the constant terms b^ 

are zero is a homogeneous system. 

3.2. The Kronecker-Capelli Theorem 

Consider a system of linear equations 


^11^1 +^12^2 + • • 


<^21^1 +^22^2 + • ■ 

■ • ~\~^2n^n — ^2 

®mi^i “f"®m2^2 “t" • 



To establish the conditions of consistency of the sys- 
tem, it is necessary to introduce the concept of the ma- 
trix of a system and the augmented matrix of a system. 

The matrix of system (1) is a matrix composed of the 
coefficients of the unknowns of the system; 



■<*11 

<*11 

<*in " 

>1= 

<*21 

<*11 • 

• <*271 


-<*ml 

<*m2 

<*m7i _ 
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If we add a column of constant terms to the matrix A, 
we get a matrix A which is known as the augmented ma- 
trix of system (1): 

r ail • • • ®in^i I 

^21 fl22 • • • fl2n^2 I 


L ^mi ^m2 • • • ^mn^m J 


It is clear from the definition of the system matrix A 
and the augmented matrix A that tlieir ranks r (.4) 
and r {A) are either equal or the rank r (A) is larger by 
unity than r (A). 

The question concerning the consistency of system (1) 
is answered by the Kronecker-Gapelli theorem: the sys- 
tem of linear equations (1) is consistent if and only if the 
rank of the augmented matrix A is equal to the rank of the 
matrix Ay i.e, when r (^) = r (A). 

Example, Test the following system of linear equations fr)r con- 
sistency: 

( 7ari-(“3a:2 = 2, 

s Xi 2x2== 3, 

I 4x1 + 9x2= 11, 


A (1) We set up a matrix for the given system and calculate 
its rank: 


“7 3' 

1= 1 ~2 . 
4 9 


7 3 

1 —2 


r(i 4 ) = 2 , since A/2 = 

(2) We set up an augmented matrix for the systernx 
A 


=fa 0. 


7 3 2' 

r= 1 -2 -3 . 
A 9 11_ 


Since A/ j 0 and the minor bordering it 

7 3 2 

A/3 = deti4= 1 —2 —3 =0 

4 9 11 

(the first row is equal to the sum of the second row multiplied hy 3 
and the third row), it follows that t {A) = 2. Thus f (A) == r (il) = 
2, i.e. the system is consistent. ^ 
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Corollary 1. If system (1) is consistent and the rank of 

the system matrix r (.4) r is equal to the number of 

unknowns n, then the system, has a unique solution. 

Corollary 2. If system (1) is consistent and the rank of 

the system matrix r (/I) ~ r is lower than the number of 

the unknowns n, then the system has an infinite number of 
solutions. 


3.3, Cramer's Rule for n Linear Equations 
in n Unknowns 


Consider a system of linear equations in which the 
nnmher of equations is equal to the number of unknowns 


I 

I 


«ll^l + «l2^2 + ••• +«in^n --^1. 

^21^1 H ^22^2 "k • * • I ^271^ n 




(1) 


and 


A r-. 

- an 

^21 

a\2 • 

^22 • 

• • am 


6i ■ 
^2 

, X r- 

-JTl 

3*2 


^ ^nl 

^n2 ■ 

• • ^nn _ 


- > '>n . 


-^n . 


are the system matrix, the column of constant terms and 
the column of unknowns respcclively. We assume that 
the determinant of tlie system 



flu ^12 • • 

• am 

d 

^2l ®22 • • 

®2n 


an\ ®fi* • - 



If now we successively replace in the determinant d 
the columns of the coefficients of the unknowns xj 
(/ — 1, 2, . . n) by the column of constant terms ft/, 
we obtain determinants 


d,= 


ft, flia 

bn • • • ^n.n-i ^nn 


^2tri-i ^271 
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0\1 


• ^i.n-1 Oin 


021 

K •• 

• ^2in-i o^n 


Oni 

'fen • 

• • Onn 


d 


n-i — 


^11 0,12 
^21 ^22 
Oni Oji2 


bi am 
bji ann 


d 


n 


Oil Oi2 
O21 O22 
^711 ®n2 


®2#n-i ^2 » 


respectively. 

Cramer’s rule. A system of n linear equations in n un- 
knowns^ whose determinant is different from zero^ is always 
consistent and has a unique solution which can be found 
from the formulas 

dffd^ ^2 dffd^ . * •) dy 

Xn = djd. (2) 

Formulas (2) are known as Cramer's formulas. 

Example 1. Uso Cramer’s formulas to solve the following system 
of linear equations: 

{ ^1 + ^2 + 2x3= — 1, 

2xi — x, + 2x3= —4, 

4xi + X2 + 4x3= —2. 


A (1) We calculate the determinant of the system: 



1 

1 

2 


1 

1 

1 

d = 

2 

— 1 

2 

= 2 

2 

— 1 

1 


4 

1 

4 


4 

1 

2 


2(-2-|-4+2+4-4--l)-r,. 


S We calculate the determinants composed of the coofricionts 

I 


be unknowns X 2 , x^: 


— 1 

1 

2 


— 1 

1 

1 

-4 

— 1 

2 

= 2 

-4 

— 1 

1 

-2 

1 

4 


— 2 

1 

2 


= 2 ( 2 — 2 — 4— 2 + 1 + 8 ) = 6 , 



Cli. 3. Solving Systems of Linear Equations 


113 


~1 2 
-4 2 
-2 4 


1 -1 1 
4 2-41 
2 -1 1 


1—12 1—11 1 _1 1 

da- 2 -4 2 - 2 2 -4 1 -4 2 -4 1 

4 -2 4 4 —2 2 2 -1 1 

-4 (-4-2-2 + 81-2 + 1)- 12, 

1 1 -1 

d;,- 2 —1 —4 =(2—16 — 2 — 4+4 + 4)=- —12. 

4 1 —2 

(3) Using Cramer’s formulas (2), wo find the solution of the 
system: 

;ri - di/d — 6/0 — 1, X2 'da/d— 12/6 — 2, 3:3— — 12/6— —2. 

Example 2. Use Cramer’s formulas to solve the following system 
of linear equations; 

X2 + -| - 3^*4 — 1 , 

+ ^2 — — 4^:4 = (), 

3^7^ — 4, 

— 3J72 '1-3.174'= — 5, 

A Wo find the determinants d, d^, d 2 , dj and expanding 
them into minors according to the elements of the last row and then 
a])plying the rule of triangles: 



2 

— 1 

1 

;{ 



1 

1 

— 1 

-1 1 

3 

d- 

|3 

- 1 

1 

, - 1 -1 

4 


1 1 

— 3 

0 

3 -11 

1 


— 3 1 - 1 - 4 I 3 1 1 —1 -=(--1).n-3.5 [ 3•^^ - 15 

3 11 3 --1 1 

(the first and the third determinant are zero since they have pro- 
portimial columns), 


-3*5-1 3*0 = 


2 

1 

-1 

6 

1 

-1 

3 

-4 

— 1 

6 

/ 

1 

-1 

1 

3 

3 

4 

1 

1 

— 4 

1 

1 - 

-5 

0 

3 
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iii 


2 

1 

3 


2 

-1 

1 

1 

— 1 

— 4 

+3 

1 

6 

— 1 

3 

1 

1 


3 

4 

1 



12-1 3 


2—1 3 


2 —1 1 

3*1 6 —4 

+ 5 

1 1 —4 

+3 

1 1 C 

i3 4 1 


3 —1 1 


3 —1 4 


=-(-1). 5-3. 15 + 5. (-5) + 3.1()- — 45. 




to 

1 


2 —1 1 

3 

1 -1 6 

-5 

1 1 -1 


3 1 4 


3 -1 1 


= (-l).()-3‘ ( — 10)-5*0-:30. 

Using now Cramer’s formulas (2), we get the solution of the 
system: 


= djd = (— 15)/(— 15) = 1, x^ = d.Jd = 0/(— 15) = 0, 

0:3 = djd = (-45)/(-15) = 3, 0:4 = djd - 30/(-15) = --2. A 

Note that tlie solution of a system of linear equations 
via Cramer’s formulas is very cumbersome. Jn practical 
calculations other methods are usually used to solve 
systems of this kind. 


3.4. Solving Arbitrary Systems of Linear Equations 
Let 

f ^ 11^1 + ^ 12 ^ 2 + * • • + 

^21^1 + ^22^2+ +®2Tl^n / 


V®mi^i + ®m2^2+ • • • + ®mn^n — 

he an arbitrary system of linear equations, where the 
number m of equations is not equal to the number n of 
unknowns (m n). 
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Wo assume that system (1) is consistent, i.o. r (A) = 
r (A) -- r and min {a/?, n}. Then in (lie matrices 
A and A of the system there arc r linearly independent 
rows and the otlier m — r rows are their linear combina- 
tions. Interchanging the equations, we may attain a sit- 
uation when these r linearly independent rows occupy 
the first r places. 

It follows that any one of the last m — r equations of 
system (1) can be repre.sented as the sum of the first r 
equations (which are linearly independent or basie equa- 
tions), taken with certain coefficients. Then system (1) 
is equivalent to the following system of r equations in n 
unknowns: 

f 1^1 h ^12^2+ * • • 

I ^21*^1 "1“ ^22*^2 'h • • • ^2Tl^n “ {^) 

anXi H ■^r2-^24~ • • • +^rn^n ” 

We assume that the 7th-order minor composed of the 
coefficients of the first r unknowns is nonzero: 



an 

ai2 • 

••air 

M,-- 

^21 

^22 • 

. a^r 


^ri 

0^2 • 

• • ^rr 


i.e. is a base minor (see 2.13). In that case the unknowns 
whose coefficients constitute a base minor are base un- 
knowns and the other n — r unknowns are constant un- 
knowns. 

In each of the equations of system (2) we transfer all 
terms with constant unknowns ^r + 2 » • • •» 

the right-hand side. Then we get a system 


bi flj ,r+ i^r+i ^i,r+2^r+2 * * * 

®2i^i ~l ’ ^22*^2 •••“[■®2r^r 

— ^2 ®2»r+l^r+l ®2.r+2^r+2 ’ • • • ®2n-^ru 

®ri^i ~\~ flr2^2 • • • “h ®rr^r 

“ bj. flriT+i^r+i ^r*r+l^r+2 * • * ^rn^ny 


( 3 ) 


which contains r equations in r base unknowns. Since the 
determinant of system (3) is a base minor Mr 0, 


8 * 
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m 

system (3) lias a unique solution for the base unknowns 
Xr which can he found from Cramer’s 
formulas. Assigning arbitrary numerical values Xj.^i = 
^'ri-2 ^2’ • • •» ^ n-r iho COIlStaTlt Ull- 

knowijs • • •> we got a special solution 

of the original system (1). 

Example. Solve the system of three equations in four unknowns 
f 3xi — 20^2 + 5^3 + 4^4 — 2 , 

^ (Ui — 4^2 -[-4^3-1 3 j-4-^3, (*) 

I Qxi — 6^2 |'3j:3 I- 2 .X 4 --4. 

A We test the system for consistency, for which purpose we com- 
pose matrices A and A: 



"3 —2 5 4 


3 — 2 5 4 2 ' 

A^ 

6—443 
.9 -6 3 2^ 


6 —4 4 3 3 
_9 — 6 3 2 4_ 


Then we determine the ranks of these matrices using elementary 
transformations: 

(a) since the first and the second column are proportional, we 
delete one of them (the second), 

(b) we multiply the first column by 1/3, 

(c) w^e multiply the result in succession, by ( -5) and (—4) 
and add to the second and the third column respectively, 

(d) in the matrix obtained, two columns (the second and the 
third) are proportional; we delete one of them (the third) and mul- 
tiply the second column by —1/6, 

(e) we multiply, in succession, the first row by (—2) and (—3) 
and add the result to the second and the third row respectively, 

(f) wo multiply the second row by (—2), add the result to the 
third row and delete the zero row obtained. 

We have 



Evidently, the rank of the last matrix is 2: r (A) 2. 

We similarly transform the matrix A: 

-[ 3-2 5 4 2 1 p 5 4 2-1 ri 5 4 2 -| 

. 1 .- 6 -4 4 3 3 U 0 4 3 3 U 2 4 3 3 

L 9 -6 3 2 4 J L 9 3 2 4 J L 3 3 2 4 J 
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0 

on ri 0-1 


*^1 

-5 

-l U 2 -l U 

Jo 

- 1 

-10 

-2.1 [3 -2j 

b 

-2.1 

- 

1 tn 




Consoquonlly, r {A) -- 2. 

Thus r (A) r (A) = 2, i.c. the system is consistent. 

Since the rank of the system is 2, it follows that tlie maximum 
onler of the nonzero minor is 2 and the system has two base un- 
knowns. We find some nonzero second-order minor, such as, for 


instance, a minor M.^ 


5 4 
4 3 


^ 0, formed by the coefficients of 


tin* unknowns and j-p Consequently, X;, and .Cj can be considered 
to he base unknowns and and x,^ to be constant unknowns. 
System (*) is equivalent to the following system: 


f 3.r j - - 2^2 -|- 52*3 I ~~ 2, 

I ^x^ — Ax.i l- 4.r, )-3.rj --3. 

We transfer the constant unknowns to the right-hand side 


!5x.vl 4ri-^2 -3xi |-2r2, 
4r3 |-3.ri -3 -0.ri 1 4.f2. 




and solve system (3) using Cramer’s formulas: 


d - 




dx- 


1 ) 1 
4 3 


-15 -IC)--— 1, 


2 - - 3 j I 2x 2 4 
3— 6.Ci |-4:r2 3 


5 2 --3.ri | -2.r2 
4 3 - O.rx |-4.r2 


-^3(2- 
- —6 


- 3j:i I - 2 ^ 2 ) - 4 [2 — Oxi \- Ax^) 


— 5(3 --(>.ri j 4.r,) 
-.7~18a:i+t2-^2, 


-4(2--3.ri-f2j2) 


r., ~ (/.,/d 6 JS.ri l'litjTa, j* ~(/|/d— — 7-1- — 12^0. 

The solution obtained, in wliich the base unknowns and .r 4 
are expressed in terms of the constant unknowns x^ and .r.,, is the 
gcmeral solution of system (*). Substituting the arbitrary values 
of tlu‘ constant unknowns into it, we get various special solutiom 
For instance, if U, .r., t), then ,r., t; r, _ -7, if .r, i, 

.r> — 2, then x.^ -^11, .r, — 13, etc. The ci/iiections of numbers 
((), 0, 0, —7), (1, 2, 11, 13) etc. are special solutions of system 
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3.5. Homogeneous Systems of Linear Equations 


Consider a homogeneous system of m linear equations 
in n unknowns: 


x'Xr 


-0. 


{ajiJ 

^21^1 4“ ^22^2 “h * • • "i~^2n‘*'?l 

®ml^l 4' ^m2^2 H' • • • 4 ^mn-^'n - 


(i) 


Since the addition of a column of zeros does not change 
the rank of the matrix of the system, this system is al- 
ways consistent by virtue of the Kronecker-C^apelly llieo- 
rern and has at least a zero solution = . . . — 

Xn “ 0). If tlie determinant of system (1) is nonzero 
and the number of equations of the system is equal to 
the number of the unknowns, then, according to Cra- 
mer’s rule, the zero solution is unique. 

In the case when the rank of the matrix of system (1) 
is lower than the number of the unknowns, i.e. r (/I) < u, 
the system has nonzero solutions in addition to tlie zero 
one. To hiid these solutions, we isolate in system (1) r 
linearly independent equations and dedete the other (Hjiia- 
tions. On the left-hand side of the isolated equatiorjs wo 
leave r base unknowns and transfer the other n — r 
constant unknowns to the right-liand side. Then wo ar- 
rive at a system 

^11^1 4“®12^2 4~ • • • 

~ ®l,r+l^r+l ®l.r+2*’'r+2 ■ * • 

^21^1 4~ ^22^2 4' • • • ~h^^2r^r 

I — ®2.r+i^r+l ®2»r+2^r+2 ••• (^) 

<^rl*^l4-flr2*^2 4- • • • 4~^2r^ r 

-- iT+l^r+l ®rir+2^r+2 ■ • • 

solving which by Cramer’s formulas, we e.xpress r base 
unknowns . . ., x^. in terms of n — r conslajjl un- 

knowns Xr-{i, ^V + 2 t • • •» 

System (1) has inliiiitely many solutions, among which 
there arc linearly independent solutions. 

A fundamental system of solutions consists of n — r 
linearly independent solutions of a homogeneous syslem 
of equations. 
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Example. Given a homogeneous system of equations 

( 2xi — 4^2 -j- 5^3 -j- 3^4 = 0 , 

< 3x1 — 6a:a+ ^x^-{-2x^ =0, 

I 4 xi — 8x2 + 17x3 + 110:4 = (I, 

find its general solution and the fundamental system of solutions. 

A (1) The number of unknowns here n = 4» the number of 
equations m = 3. We calculate the rank of the system matrix using 
elementary transformations: 

(a) delete the second column since it is proportional to the 
first column, 

(b) multiply the third column by (— 2 ^ and add the result to the 
second column and then multiply it by (—3) and add it to the 
first column multiplied by 2 , 

(c) delete the first column since it is proportional to the second, 

(d) multiply the first column by 3 and add the result to the 
second column, 

(e) multiply the first row by 5 and add the result to the fourth 
row, 

(f) delete the third row and divide the first row by (— 1 ) and 
the second rovv by 2 . 

We have 



~2 -4 5 3' 

(a) 

■2 5 3" 

(»>) 

“ -5 -1 3 

A - 

3 —6 4 2 
J -8 17 11 . 


3 4 2 
.4 17 11 

— 

0 0 2 
^-25 -5 11. 


(c) r -1 3 1 (d)r-i 0 ' (e) r -1 

^ 0 2 - 0 2 -- 0 2 
_.5 11 J —5 _4 J L --4_ 


-“’rv;]. 

Since r (A) - 2, i.e. r < min {m, r?), the given system has 
a fundamental system of n — 2 — 4 — 2 — 2 solutions. 

(2) We shall seek the general solution of the system. We find 
the base minor, i.e. a second-order nonzero minor. Such is, for 
instance, the minor composed of the coefficients of X 3 and X 4 in 

5 3 

the first and the second equation of the system: “ 

2 0 . Leaving the base unknowns X 3 and X 4 on the left-hand side 

and transferring the constant unknowns x^ and x.^ to the right-hand 
side, we arrive at a system 

{ 5x., |- 3 x 4 = — 2xi I 4 x 2 , 

4.r., + 2x4— — 3 xi + 0x2. 

Its solution, found from Cramer’s formulas, has the form 
X 3 — —2.5x4 "H 5x2, 

X4 — 3.5xi + Tx^. 
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(3) To obtain a fundamental system of solutions, vve must find 
any two linearly independent solutions of the system (since n — 
r = 2). Setting first = 1, Xj = 0, we have Xg = —2.5, X4 — 3.5; 
setting then Xi = 0, Xg = 1, we get x.^ = 5, X4 = —7. Tims the 
fundamental system of solutions has the form 



and the general solution is /? = + 02/^2? where Cj and 

are arbitrary numbers. 

Assigning different values to and Cg, we can gel any solution 
of the given system. 

Assume, for instance, that x^ = l,x.2 = 2. Then x^ — — 2.5 1 + 
5.2 = 7.5, X4 = 3.5*1 — 7*2 — — 10.5. The special solution 



obtained is a linear combination of the solutions which constitute 
a fundamental system for = 1, Cg = 2, R -= R^ -|- 2R.^. ^ 


3.6. Basic Elimination Procedure 

Consider a system of n linear equations in n unknowris 


^11^1 + ^12^2+ • 

• +«l<7^f/ + • 

•+^^17l^n — ^^l,7l+H 


^21^1 + ^22^2+ • 

• + + • 

'+^271^71 — ^2-71+1 » 


®P1^1 + ®P2^2+ • 


• “h^pTi^n — ®pi/i + i » 

(0 

1^1 + ^712^2+ • 

• • + ^nq^q + • 

• +'^7171^71 — ®7l .7lH* 



We set up an augmented matrix of system (1): 

^11^12^13 • • • ®l<7 ••• ®in®l.n+i "" 

2l®22®23 • • • ^2<7 * • * ^2n^2-fl + l 


. . . (ipnf^pin+i 

I 

— ®ni®7i2®r»3 • • • • • ®an^ritrn-i 


pldp^f^p 3 * 


ipq 
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We choose the largest in absointe value nonzero element 
of matrix A whicli does not belong to tJie column of 
constant terms. This element is known as the piuot ele- 
ment, We calculate the multipliers for 

all rows with the numbers i p (tJjo /jih row which 
contains the pivot element is known as the pwot row). 

Then we add, to every nonpivot ith row, the pivot row 
multiplied by the corresponding multiplier for that 
row. For example, 

apq 

/;(n and so on. 

«/>(/ 

We obtain a now matrix, in which all the elements of 
the 7 th vAilumn, except for a^q, consist of zeros: 



<^pq 


Deleting this coliiinn and the pivot /Uh row, we get a new 
matrix the number of whose rows and columns is 

smaller by unity. We repeat the operations for the matrix 
and get a matrix and so on. 

We thus construct a se(iuence of matrices A, 

the last of which is a binomial row 
matrix (the pivot row). To hnd the unknowns .r,, we 
combine all llie pivot rows, beginning with the Iasi row, 
into a syst(*m. 

This method of solving a system of linear equations in 
n unknowns is the basic eliininalion procedure (also 
known as the method of pivot selection and as pivotal- 
condensation juethod). The necessary condition for its 
application is that det A 0. 
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Computational Mathematics 
Use the method of pivot selection to solve the 


{ 


3xi -\- 2X2 + ^3 ~ 
2x1-1-53:2 + 3:3= —3, 

2xi + X2 + 8x3 =11. 


A (1) We compose an augmented matrix A of this system, lind 
the pivot element and calculate the multipliers mi'. 


-3 2 1 5-1 

2 |T| 1 -3 . 

-2 13 11 - 


®22 ~ pivot element, nii — — 2/5, m.^ ~ — 1/5. 

"" (2) We seek the matrix We have 

^11 ^ 5~ 5 » ^ 5 ” 5 ’ 

^3-1.1=:^, M,V - 1 H- 3 . -i = + 


r 1/5 3/5 31/5-1 

8/5 \ lm \ 58/5 J • 

Here fty.’ — 14/5 is the pivot element, = — 1/14. 

(3) We seek BC‘). We have 

Mi). ii_ 8 A _ « frm- Jl_ 58 ._3__A 

“ "'5 5 ■ 14 7 ’ ~ 5 5 14 7 


BW ---[13/7 2(5/7). 

(4) Using the pivot rows, we arrive at a system 

f 2xi + 5 x 2-|-X;,= - -3, r 2xi-l 5 x2 + X 3= — 3, 

•i + (14/5) x., = 58/5, or ^ 4xi + 7x3-2t) 
Xi-26/7 I 13xi--2(). 


The reverse operation yields Xj = 2, x.^ -- 3, x.^ ^ —2. 


To solve systems of linear equations by the method of 
pivot stteetion, we can use the scheme presented in 
Table 3.1 (the pivot elements iT\ it, which have been 
chosen arbitrarily, are framed and the pivot rows arc 
labelled by roman tigures 1-1 V). 
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Table 3.1 




Example 2. Use tlie method of pivot selection to solve the system 
2a: 1 -| - a" jj + 2 X 3 3.r4 — 1 , 

Sa:^ 2 a:., a: 3-|-2x4: — I, 

4a: 1 + 3^2 -j- 2 a*;, -f- a:^ — — 5 . 

A The sohition is given in Table 3.2. 

Thus we obtain a system 

a:^ —3, 

-{4/3)a:2 -(2/3)a:3 --2/3, 

(15/4) a:i + (^/2) -^, + (5/4) a:, - -25/4, 

2.r2-l- 3^;, +4^4 — 5, 

whence wo find that = —3, Xg — 2, = —2, 1:4 = 3. 
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Table 3.2 



Columns of the system matrix 

Constant 

terms 

2: 

Pivot 

lows 

Ma- 

trices 

XI 

X2 

^3 

Xi 



1 

2 

3 

0 

5 

15 



-3/4 


2 

1 

2 

3 

1 

9 

1 

X 

-1/2 


3 

2 

1 

2 

1 

9 



-1/4 


4 

3 

2 

1 

-5 

5 



-1/3 


5/4 

-1/2 

-1/4 


-11/4 

-9/4 



-2/3 


5/2 

1 

-1/2 


-3/2 

1 

III 

B(') 



|W4l 

^12 

5/4 


-25/4 

5/4 






-4/3 1 

-2/3 


- 2/3 

-8/3 

1 

/^(-) 

-1/2 



-2/3 

-4/3 


8/3 

2/3 






-1 


3 

2 

IV 

HW 


3.7. Solving Systems of Linear Equations 
by the Gauss Elimination Method 

Tlio Gaussian elimination is the most popular method ol 
solving systems of linear equations. It is a special case 
of the basic elimination method when the upper left 
nonzero element of the system matrix being considered 
is chosen as the pivot element. 

Here is an example of solving a system of four equations 
in four unknowns by this method. Consider a system 

r aii^i -[- 012^2 “h + ^11^4 — 

I ®2l^l ^22^2 ^24^4 ~~ » /4\ 

I ^31^1 ~h ^32^2 I' ^33-^3 “h ®34^4 “ '^3:n 

1^41^1 ^42^2 H~<*43^3'h®44'^4 ~ ^4r)* 

We shall eliminate the unknown from all equations 
of system (1), except for the first equation. We call 
the piuot unknown and the coefficient the pivot coef- 
ficient. Dividing the first equation by (this is possible 


Ch. 3. Solvin" Systems of Linear Equations 


125 


if Cl, # 0), we gel, 


_^12 


^ ^14 ^ _ ^ir> 

^11 ■* ' ^11 * ^Ji * 


Wo dosigriato -— ^^13, dijo^-y — - ^-^14, 

air/rtji ^ and, in general, (/ > ^)* Then 

tlie equation being considered assumes the form 

‘^1 I i d ~ 


or 


^1 “ ^^15 — ^^2^2 — — ^^14^4. 

To eliminate the unknown ./•, from the equations of 
system (1), we perform tlie following transformations. 

(1) We subtract equation (2) multiplied by from 
the second equation of system (1), 

^21^1 ^22^2 *d“ ^23^3 '1~ ^24^4 ” ^25 

Q2d^l2^2 ~~ ^21^1 3^3 ^2d^l4^4 ~ — 0'2l^^ 15 

(^/22- ^2d'l2) -^2 l'{«23 ■«2d^l3)^;r|-(«24 -«2d^l4) *^1 ' ’ 

designate 

^^2 2 d 21^^12 ^22’' ^23 ^21^^13 “ 

d y/l d2\hi/i “ ^24*’ ^25 ^21^^16 “ ^2:/ 

and rewrite the resulting equation in the form 
^^2^2 ^^^3^3 '1' ^2V^4 ^^2V- 

(2) From the third equation of system (1) we subtract 
equation (2) multiplied by a^ii 

d“ ^32^2 d' ^33^3 d~ dv^i^Xi^ — 

^31^1 fl3l^^l2^2 ^31^13^3 ^31^^14^4 ~ ^31^^15 

(^32 ^31^12) ^2 'b (^33 "“^31^13) ^3d'(<^34 ^^31^)4) ^4 ' ^35" ^31^^15 ’ 

Designating a ^2 — ^^3i^b2 = ^^33 — ^Lu<'b3= and 

so on, we rewrite the resulting equation in the form 

^3V^2 d~ ^3 d" — ^^5^ • 

(3) From the fourth equation of system (1) we subtract 
equation (2) multiplied by Using similar designations, 
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we get the following equation: 

As a result of these elementary transformations, we have 
a system of three equations in three unknowns 

4' V^4 ~ ^2V » 

^ ^3 -f ( 1 ' ) 


where the coefficients aij (i, / ^ 2) can be found from 
the formula Ui)^ = aij — (say, ^^33 -- «2i^h2)- 

Dividing then the coefficients of the first equation of 
system (!') by the pivot coefficient =7^ 0, we get the 
first equation of the system in the form 


nil) 

“23 


“24 




^22 


_ r -i- r -- - 

) •'* r Ml) -^4 - ' Ml) 

“"22 “oo 


We designate 

n'M-® 

and, in general, ^2/ ^^22^ “ ^^2/ (/ > 2). Then the first 
equation of system (!') assumes the form 


^2 4 “ ^3 + » ( “^ ) 

or 


^2 --= //2‘ft — — ^^2 42:4 . 

Eliminating now from all equations of system (!'), 
except for the first, in the same way as we eliminated x^, 
we arrive at the following system of two equations in 
two unknowns: 


f4*3’*3+«3*^a:4 = 4*^, 

1 4*32:3 + aW^4 = «4’‘5, ^ ' 

where a\f = 4^ — 42 f> 2 } {h j ^ •!)• (Por example, 
^sV “ ^34* — ^aV Dividing the coefficients of the 

first equation of system (1") by the pivot coefficient 
«_‘g =7^ 0, we get 

■ ^3 + (2") 
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where = aaj/a^y (/ > 3), i.e. 

EliminaliTig now j"., similarly from system (1"), we 
find that 




where (i, j ^ 4). Hence 


^4 ~ 


l"ho other unknowns of the system can be found in succes- 
sion from equations (2"), (2') and (2): 

^2 ^ '^2*5 — /4V^4 — ^^23^31 

" ^15 • 

Thus the Gaussian elimination reduces to constructing 
an equivalent system of equations (2), (2'), (2'"), (2'"). 
The Gaussian elimination can be used when all the pivot 
coefficients are different from zero. 

For the sake of convenience, we carry out the calcu- 
lations according to a scheme of unique division. The cal- 
culation of the elements hij is a forward substitution and 
the calculation of the values of the unknowns is a back 
substitution since we first determine the value of the last 
unknown. 

The scheme for the unique division (Gauss’ scheme) 
is composed as follows. 

Section I of the scheme (see Table 3.3) includes the 
coefficients of the unknowns (in the columns of the cor- 
responding unknowns), constant terms and, for each 
row, “control sums” (column 22 )* ^qual to the sum of the 
elements a;; in that row (here i = 1, 2, 3, 4, j = 1, 2, 3, 
4, 3); the last row of Section 1 consisting of 1 and the 
elements bij results from the division of the first row of 
that section by the pivot coefficient 

The elements of Section II of the scheme are equal to 
the corresponding elements of Section I minus the product 
2); for instance = Oga ~ ^ 21 ^ 13 - "The 
last row of Section II consisting of 1 and the elements 
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Table 3.3 



2 l 

Z 2 

Sections 
of the 
scheme 



flia = «11 + ®12 ‘ 1 ' ^ 13 + ^14 + ^15 

^26 = ®21 “h ^22 + ^23 + ®24 'H ^25 

^38 = ^31 + ®32 + ^33 + ^34 "H ^36 
^46 = ^41 + ^42 + ^43 + ^44 + ^45 

I 

Forward substitution 


h 

Olo— “ — 

^11 

^16= 1 I' ^ 12 + ^13 + ^14 + ^15 


^28^ r-=a26 — ^21^16 

<>-4.i>l-<+4i’-l< 

flU>=4i'+a^y-l-«s.iM-aiV 

“ilt’ =- “42 -I • “i” + “U’ H - «4r.’ 

II 


^( 1 ) 

;.(i) _-£il 

■■ 

6 !,V-t+ 6 <!M-&;,i>H-t^'' 




III 


6 ca.- 2 =» 

"»• “"aiS- 

&!.!’ = i+&^V+&iV 


aJi^’ -“ 


IV 


1 

>,(3) 

J.(3) — ^46 

biV = i + bg' 


i4 = &« 

X 2 = 628 ^ ^2V^4 — 

^1 = 2^16 “^ 14^4 

— ^18®S ^^ 12^2 

^4—1 + ^4 

1 + ^3 

3*2— 1 + 3^2 

oTj — - 

V 

Back substitution 


9-0104 
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b 2 j results from the division of the lirst row of that 
section by the pivot coefficient agV- 

The elements of the third and fourth sections of the 
scheme are calculated in a similar way. Sections I, II, 
III and IV, which end with the calculation of the elements 
6 (j-i) (i = 1, 2, 3, 4, j = 2, 3, 4, 5) constitute a forward 
substitution of the calculation of nit:; sunt^mu. 

The back substitution begins with the calculation of 
the last unknown of the system of linear equations 
and ends with the calculation of the first unknown Xi. 
In the back substitution only the rows of the forward 
substitution are used which contain unities and the cor- 
responding elements bij (we call these rows “marked”). 

The element b^^l of the last “marked” row and the 
column of constant terms yields the value of Then the 
other unknowns Xq, x<^ and Xy are found by subtracting 
the sum of the products of its coefficients by the corres- 
ponding values of the unknowns found before, say, x^ = 
- bf: X 4 ^ from the constant term of the “marked” row. 

The values of the unknowns are written in succession 
in Sec. V. The unities written there allow us to find 
the corresponding coefficients for xj in the “marked” rows. 

The so-called control sums which are in the column 2 2 
are used to verify the calculations 
5 , 5 

^ 16 ” 1? 2, 3, 4) and b^^ ■ - ^ 2, 3, 4). 

In the column 2i Sections II, III and IV the same 
actions are performed on the control sums in each row as 
on the other elements of that row. If there are no errors 
in calculations, the elements of the columns 2 i S 2 
are equal. Thus we control the forward substitution of the 
scheme. _ 

To control the back substitution, we find x^ in the 
last “marked” row of the column 2 i» ^4 = 

find the other unknowns of this column a:; (7 = 3, 2, 1) 
in the pme rows and from the same formulas as the 
unknowns Xj^ with the only difference that we substitute 
the appropriate xj into the formulas. In the result, the 
numbers xj must coincide with the numbers xj -\- i of 
the column S 2 - 
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Table 3.4 


XI 

X3 

X3 

X4 

Constant 

terms 

Si 

S 3 

Sections 
of the 
scheme 


2 

-1 

1 


8 

■ 


4 

3 

-1 



14 


I 

8 

5 




26 



3 

3 




12 

■ 


1 

1 

-0.5 

0.5 

2 

4 

4 



l-i| 

' 1 








1 



-6 


II 


0 

-0.5 


0 

0 

0 



1 

1 

-1 

0 

2 

2 

2 




EB 

0 

2 

0 

0 




-0.5 

0.5 

0 

0 

0 









TTT 








ill 



1 

0 

-1 

0 

0 





|0.5l 

-0.5 

0 

0 

IV 












-1 

0 

0 





1 

X4=.--— 1 

X4 = 0 

0 




1 


ij= —1 

X3 = 0 

0 

V 


1 



X2= 1 

X2 = 2 

2 


1 




Xi= 1 

Xi = 2 

2 



Example 1. Use the scheme of unique division to solve the 
following system: 

! 2^1 + 2x2— X3 + X4 = 4 , 

4 xi + 3 x 2 — X3 +2x4 = 6, 

8x1 + Bxg — 3x3 + 4x4 = 12, 

3 xi + 3 x 2 —2x3 + 2x4 = 6. 


9 * 
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A In section I ol Table 3.4 wo write the matrix of the system, 
its constant terms and control sums. Then we calculate the “marked” 
row of this section dividing its first row by an — 2, for instance 
^12 ~ ~ ^ — 1. 

The elements of Section II are calculated according to the 
following rule: every element of this section is equal to the corre- 
sponding element of Section I minus tho product of the first element 
of its row by the element of the “marked” row in its column. We 
write the result in the respective place in Section II. For example, 

— ^21^13 ~ ^ il.5) = l, 

= flgg — ^31^1 3 ~ 3 ^ “ 1* 

Wo obtain the elements of the “marked "row of section II by divid- 
ing its first row by the pivot coefficient == —1, for instance, 

By analogy we calculate the elements of sections III and IV, 
for example, 

fliV = = 2 ~ 3 • 0 .f) = 0.5, 

’ - (iWl = 0 ^ ( - 0.5) ( - 1) — - 0.5. 

To calculate the elements of section V, i.e. to find the unknowns, 
we use the “marked” rows, beginning with the last row. 

The unknown is a constant term of the last “marked” row: 
^4 = the other unknowns 0:3, and Xi result from 

the successive subtraction, from the constant terms of tho “marked” 
rows, of the sums of the products of the corresponding coefficients 
by the yalues of the unknowns obtained before. 

The verification is done with the aid of columns 2i 22* 
The same actions are performed on the column as on the other 
columns (see Tables 3.3 and 3.4) and, as a result, the sum of the 
elements of every row of the scheme (without the column ^i) 
must be equal to the element of that row from the column ^2* 
The numbers xj from the column must bo equal to the numbers 
i Xj from the column 

As a result we obtain = 1, arg = 1, 0:3 — 1, — 1 . 

Example 2. Using the scheme of unique division, solve the follow- 
ing system with an accuracy of 0.0001: 

{ () .63^1 + 1 .00a:2 + 0 .71x3 + 0 .34x4 = 2 .08, 

1.17x1 + 0.18x2 — 0.65x3 +0.71x4 = 0.17, 

2. 71a;i — 0.75x2+1.17x3-2.350:4 = 1.28, 

3.58x1 + 0.28x2 — 3.45x3 — 1.18x4 = 0.05. 

A The solution of the system is given in Table 3.5. Tho final 
answer is xi = 0.4026, Xj = 1.5016, Xg = 0.5862. X4 = —0.2678. 4 



Constant 

terms 


CD 00 CD CT) 


OO l^OOlO 
O (M O 


vr lo 00 

CO I'- CO 

d dcv] 'fH 

I I 


—1 lO »o 

CO r-lsr 


r -rH i- (N 


CO -r 
O) vj< tr- 
io -H CO 

CNJ vjHOO 
t- 00 t- 

I ’’HCsI 


CO '^O 
05 

lO 'tHCO 
C'J S^OO 

I'- 00 1-- 
I r-.(N 


CO vt(M 
CO 00 
Oi CO I-- 
CD CD 


I- CD 

05 O 05 
I- 

o 00'^ 

d COCO 


CD 00 oO 
05 00 Nj* 


t- -rH 00 
l> lO 


00 vO 
O ^ 
lO t-- 

o sr 

lO lO 

I I 


<M CD 
th sf 
C'l 05 
Vrt 

CO s^ 

I 


CM CD 

-tH v.-^ 

CM 05 
iQ 

vlj ^ 

CO 


V}< 

sj< CM 
CD O 
iO 00 
VlJ (M 

CO r 


CD CO 
00 CD 
05 00 
vf CD 
O CO 

^C^ CO 


‘^1 


lO lO >7' 

<<-1 CM CD 1-0 
CM CD CM 
CO 00 O O 
L'- lO lO vr 

O CM 


lO lO sf 
— « CM CD lO 
CM CD D1 
CO 00 O O 
t-j lO lO sT 

"D ^ CM ^ 


I Hi Hi Hi H 


lO lO 

QO CM CD 1.0 
t- CO CM 
CD 00 r r 

CM LO to sl< 
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If the approximate values of the unknowns obtained 
according to Gauss’ scheme are sufficiently accurate, 
i.e. the corrections are small in absolute value, the 
refinement is not necessary. 

When it is necessary to make the approximate values 
of the unknowns more accurate, we must do the follow- 
ing: 

(1) for every equation of the system wo calculate the 
errors, i.e. the differences between the right-hand and 
left-hand sides of the system resulting from the sub- 
stitution of the approximate values of the unknowns into 
the equations; if we designate the approximate values of 
the unknowns as , the errors as 

. . ., En and the constant terms as . . ., then 


62 = 62— 2 ^ 2 ^ 4 % 

;=-l 


^nj^j 

j=l 

(2) we write the errors e,- (i = 1, 2, . . ., n) in a sepa- 
rate column e of Gauss’ scheme and perform the same 
actions on it as on the other columns of the scheme, 

(3) considering the column e to be a column of constant 
terms, we obtain the corrections 6/ for the unknowns, 

(4) we find the precise values of the unknowns adding 
the corrections to the corresponding approximate 
values of the unknowns 

Xj = 6i» ^2 “ ^2°^ • • •’I X, I — j:'n^ dfi- 

Example 3. Use Gauss’ method accurate to three decimal places 
to solve the system 

r 7.09.x, + 1 .17^:2-2.23x3-= -4.75, 

< 0.43x,+ 1.4x2 -0.62x3-= -1.05, 

[ 3.21xi-4.25xj + 2.13xg = 5.n6 
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and make the approximate values of the unknowns obtained accurate 
to 10 -«. 

A Using Gauss* scheme, we calculate 3 : 2 °^ and with 
three significant digits (Table 3.6). 


Table 3.6 



X2 

3^3 

Constant 

terms 


B 

m 



m 


0.00097 

0.00087 

-0.00295 

1 

0.1650* 

-0.3145 

-0.6700 


0.00014 


1.32901 

_ A 

-0.4847 

3.1395 

-0.7619 

7.2107 

0.0824 

5.5706 

0.00081 

-0.00340 


1 

-0.3647 

- 0.5733 

0.0620 

0.00061 



1.3964 

4.47<'5 

5.8669 

-0.00048 



1 

3.2015 

4.2015 

-0.00035 

1 

1 

1 

3.2015 

0.5943 

0.2388 

4.2015 

1.5943 

1.2388 

- 0.00035 

-0 .n0048 
-0. 005 


Thus a:<o>---( 1.239, 0.594, = 3.202. 

[6x1 

To find the correction 6=1 62 , we must solve the given 

L63 J 

system with the same matrix 

[ 7.09 1.17 —2.23"^ 

0.43 1.4 -0.62 
3.21 -4.25 2.13, 


and new constant terms e,- (errors) which we shall calculate as 
follows. 
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1. We calculate the errors, for which purpose we substitute the 

values of into the equations of the system: 

7.09-0.239 + 1.17-0.594 - 2.23-3.202 = -4.75097, 
0.43-0.239 + 1.4-0.594 — 0.62-3.202 = —1.05087, 
3.21-0.239 - 4.25-0.594 - 2.13-3.202 = 5.06295. 

The errors are equal, respectively, to 

ei = —4.75 — (—4.75097) - 0.00097, 

Ca = -1.05 - (-1.05087) = 0.00087, 

83 = 5.06 — 5.06295 = -0.00295. 

2. To solve the given system, we use Gauss’ scheme with con- 
stant terms 81 = 0.00097, 83 = 0.00087, 83 = —0.00295. Corres- 
pondingly, with an accuracy of 10"^, we get the values of the cor- 
rections 61 = — 0.0004, 62 = 0.0005, 63 — — 0.0001. Then wo 
make the unknowns more precise: 


xi = x<o> -f- 61 '-=0.239 — 0 .0004 = 0 . 2386; 

X2 = xi®> -[- 62 - 0.594 -f- 0 .0005 = 0 .5945; 

= + -=3.202-0. 0001 = 3. 2019. A 


3.8. Calculating Determinants by 
the Gauss Elimination Method 


Gaussian elimination can be used to calculate the 
determinants: 


®12 ®171 

^21 ®22 ®2 n 

^711 ^712 ®7l7l 


.7 


a 


,01-1) 


where flu, the pivot (dcinonts 

of the scheme of the unique division. 

Example 1. Using the scheme of unique division, calculate the 
determinant 


112 3 

3-1-1 -2 
^^2 3-1 -1 

1 2 3-1 

A The solution is given in Table 3.7. 
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Table 3.7 


Columns 

^1 


1 

2 

3 

4 

FI 

1 

2 

3 

7 


3 

-1 

-1 

-2 

-1 


2 

3 

-1 

-1 

3 


1 

2 

3 

-1 

5 

1 


1 

1 

2 

3 

7 

7 


1 -'0 

-7 

-11 


-22 


1 

-5 

-7 


-11 


1 

1 

-4 


-2 


1 

1 

1 

7/4 

11/4 

1 

22/4 

22/4 



-27/4 1 

-39/4 


- 66/4 



-.3/4 

-27/4 


-30/4 



1 

13/9 

22/9 

22/9 




1 -17/3 

1 -17/3 

-17/3 

1 


Thus d - l-(-4).( -27/4). (-17/3) = -153. ^ 

Example 2. Using the scheme of unique division, calculate the 
determinant 

1.00 0.42 0.54 0.60 ! 

0.42 1.00 0.32 0.44 
0.54 0.32 l.ihMi. 22 
0.06 0.44 0.22 1.00 

with an accuracy of 0.001. 

A The solution is given in Table 3.8. 

The final result is ci - 1.0.8236.0.6978.0.4979 = 0.286. ^ 
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Table 3.^ 


Columns 

21 

29 

1 

2 

3 

4 

m 



1 


2.62 


^42 

BEH 


■ 


2.18 


0.54 


1.00 


0.22 

2.08 


0.66 

■■ 

0.22 


1.00 

2.32 


1 

0.42 

0.54 

0.66 

2.62 



I 0.8236 1 

0.0932 


0.1628 

1.0796 



0.0932 

0.7084 


0.1364 

0.6652 

0.6652 


0.1628 

-^ 0.1364 


0.5644 

0.5908 



1 

0.1135 

0.1973 

1.3108 

1.3108 



IBSll 

. 

- 0.1548 

■1 

■1 



- 0.1549 


0.5323 





1 

- 

- 0.2219 

0.7782 

0.7781 





0.4979 1 

0.4979 

0.4979 


3.9. The Gaussian Elimination for Inversion 
of a Matrix 

Consider a nonsingular matrix A ~ [aij] (i, j = 
1, 2, . . n). To find its inverse = Ixij], we use the 

fundamental relation AA~^ = /, where / is an wth-order 
identity matrix. 

Thus, for a fourth-order matrix, performing the multi- 
plication 


®12 ®13 ®14 


^12 ®18 ^14 


"1 0 0 0" 

®2l ®22 ®24 


^2l ^22 ^23 ^24 


0 10 0 

flai ®33 


^31 ^32 ^33 ®34 


0 0 10 

®4X ®43 ®43 ®44 - 


- x^i 3:43 3:44 - 


-0 0 0 1 , 
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we get four systeins of equations for 16 unknowns Xij 
(i, j = 1, 2, 3, 4). 

In the general case, we have relations 

n 

S ^hj --- ^ij (^» •••» ^)* 

h=^i 

where 

( 1 for /, 

0 for 1 = 5 ^ 7 , 

6,j is the Kronecker delta. 

Then n systems of linear equations obtained for 
j = i, 2, n have the same matrix A and different 
constant terms which constitute an identity matrix, and 
tlicreforc we can use (laussian elimination method to 
solve these systems. 

Tlie sohilions found according to the scheme of 
unique division are the elements of the inverse matrix 
A-K 

Example 1. Use Gauss’ method to invert the matrix 

11 ) 12 - 
-12 3 1 

4 0 -2 1 • 

- 0 2 12 - 

A The solution is given in Table 3.9. 

Thus 


0 

1/3 

1/3 

-1/3 

1/2 

1/6 

1/6 

1/3 

1/5 

7/15 

1/15 

-7/15 

2/5 

-2/5 

-1/5 

2/5 



Example 2. Invert the matrix 

l.oi) 0.47 — n.ll 0.55' 

0.42 1.00 0.35 0.17 

—0.25 0.67 1.00 0.36 

- 0.54 — 0..32 — 0.74 1.00., 


using Gaussian elimination method. All the calculations must be 
done to four decimal places. Round off the answer to three decimal 
places. 

^ The solution is given in Table 3,10. 



140 


Computational Mathematics 


Table 3.9 


x-jy 


^3j 



i = 2 

j = 3 

j = 4 

Si 

22 

|T| 

0 

1 


■1 

0 

0 

0 

5 


— 1 

2 

3 


0 

1 

0 

{) 

0 


4 

0 

-2 


0 

0 

1 

0 

4 


0 

2 

1 


0 

0 

0 

1 

6 


1 

0 

1 


1 

0 

0 

0 

5 

5 


111 

4 

3 

1 

1 

0 

0 

11 

11 


0 

-6 

-7 

^4 

0 

1 

0 

—16 

-16 


2 

1 

2 

0 

0 

0 

1 

6 

6 


1 

2 

3/2 

1/2 

1/2 

0 

0 

11/2 

11/2 



|-6l 

-7 

~4 

0 

1 

0 

-16 

-10 



3 

-7 

-1 

-1 

0 

1 

1 

-5 

-5 



1 

7/6 

4/6 

i) 

-i/6 

0 

16/6 

16/6 




| 572 | 

1 

-1 

-1/2 

1 

3 

3 




1 

2/5 

-2/5 

-1/5 

2/5 

6/5 

6/5 




1 

2/5 

-2/5 

-1/5 

2/5 

6/5 

6/5 



1 


1/5 

7/15 

1/15 

- 7/15 

19/15 

19/15 


1 



-1/2 

1/6 

1/6 

1/3 

7/6 

7/6 

1 




(1 

1/3 

1/3 

-1/3 

4/3 

4/3 


Consequently, 


1.9759 —1.2017 —0.0120 —0.8781 " 

— 1.2883 2.1003 —0.4869 0.5268 

1.4921 —1.7239 1.0873 —0.9189 

- —0.3750 0.0453 0.6553 0.9620 . 


r 1.976 —1.202 —0.012 -0.8781 


— 1.288 2.100 —0.487 

1.492 —1.724 1.087 

,—0.375 0.045 0,655 


0.527 
— 0.919 
0.963-1 


▲ 


. 4-1 = 
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Table 3.10 



^ 2 ) 



i = 1 

1 i.t'U 1 

0.42 

-0.25 

0.54 

0.47 

1.00 

0.07 

-0.32 

-0.11 

0.35 

1.00 

-0.74 

0.55 

0.17 

0.36 

1 .00 

1 

{) 

0 

0 

1 

0.47 

-0.11 

0.55 

1 


0.8026 

0.7875 

-0.5738 

0.3962 

0.9725 

-0.6806 

-0.0010 

0.4975 

O.7030 

-0.4200 

0.2500 

-0.5400 

1 

1 

1 

0.4936 

-0.0760 

-0.5233 



10.58381 

-0.3974 

0.5573 

0.6594 

0.6621 

-0.8403 



m 

0 .9546 

1.1341 



IB 

IB 

-0.3896 



IB 

IB 

-0.3750 

1 

1 

1 

1 

X4i= —0.3750 
x,i= 1.4921 
Xji= — 1.2883 
xn= 1.9759 


i =- 2 

i = 3 

i = 4 

B 


0 

0 

0 

2.91 


1 

0 

0 

2.94 


0 

1 

0 

2.78 


0 J 

0 J 

1 

1.48 


0 

1 

0 

0 

2.91 

2.91 
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Table 3,10 continued 


J = 2 


j = 4 

Si 

S 2 

1 

0 

0 

1.7178 

1.7178 

0 

1 

0 


3.5075 

0 

0 

1 

-0.0914 

-0.0914 

J .2460 

0 

0 

2.1403 

2.1403 

-0.9812 

1 



1 .8220 

0.7150 

0 



1.1367 

-1.6807 

1.7129 

0 

3.1209 

3.1209 

0.0471 

0.6807 

1 



0.0453 

0.6553 

0.9626 

2.2882 

2.2882 

a:42 = 0.0453 

0 : 43 = 0.6553 

X 44 = 0.9626 

2.2882 

2.2882 

•^S2 — 1 *7239 

0 : 33 = 1.0873 

3:34 = — 0.9189 

0.9366 

0 .9366 

2.1003 

X2s = —0.4869 

ar24 = 0.5268 

1 .8519 

1.8519 

1 

ii 

n 

IH 

xi 3 = - 0.0120 

a;i 4 = -0.8781 

0.8841 

0.8841 


3.10. Cholesky^s Method 


Assume that a system of linear equations is given in 
the matrix form 


Ax = b, 


( 1 ) 


where A — [aij\ is a 


square matrix of order n. 


and 





®l.n+i 

x = 

^2 

and b = 

®2,n+i 










are column vectors. 


We represent the matrix A as the product of the lower 
triangular matrix C = [c/y] and the upper triangular 
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matrix B = [6,-^] with a unit diagonal, i.e. 

A = CB, 


where 



r cii 0 0 

. 0 “1 


n hi 

^13 • 

• • ^171 


^2l ^22 ^ 

. 0 


0 1 

&23 • 



^31 ^32 ^33 

. 0 

, B = 

0 0 

1 . 

• ^371 


— ^nl ^712 ^713 • • 

• ^7171 _ 


_0 0 

0 . 

•• 1 


The elements Cij and 6/y are found from formulas (17) 
and (18) of 2.0: 

i-i 

Cii = Oil, Cij - — s O Ai for 1< ; < i, (3) 

k=l 

1-1 

btj = , bt) for 1< i<}. (4) 

We can write equation (1) in tlie form 

CBx = b. (5) 

The product Bx of the matrix B and the column vector x 
is a column vector which we designate as y: 

Bx = y. (6) 

Then we can rewrite equation (5) in the form 

Cy = b, (7) 

or 


"cii 0 0 ... 0 


'yi ‘ 


fll. 71 + 1 

C21 C22 ^ • 0 


1/2 


®2. n+i 

^31 ^32 ^33 • • • ^ 


ys 


®3i 71 + 1 

^n2 ^ns ••• ^nn. 


.yjt - 


-®ni n+1- 


The elements c/; (i, / = 1, 2, . . n) here are known 
since the matrix A of system (1) is assumed to be expand- 
ed in the product of two triangular matrices C and B 
[formulas (3) and (4)]. 
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Multiplying the matrices on the lelt-haiul side of re- 
lation (7'), we got a system of equations 

^llVl — 7l+l» 

^ ^ 2 l/l ^ 22 l /2 — ^ 2 i n+lj /g\ 

^3l!/l~l"^32i/2 + ^33i/3 = ®3. n+l» 

^ ^n2.V2"l"^n3J/3~l ' • • • H" ^nni/n = ®n.n+i» 


whence we obtain the following formulas for tlio 
unknowns: 


n+i . 

ijt - . I/. 


i-1 

®i» n+l 2 

^>1. (9) 




It is convenient to calculate the unknowns yi together 
with the elements hij. 

When all (i = 1, 2, . . n) are found from formulas 
(9), we substitute them into equation (0): 


1 . bi2 hi2 . . . biji 


“a:i 


"Vi " 

01 0 ... bin 


^2 


i/2 

0 0 1 . . . bin 



-r 

i/3 

.00 0 ...1 . 


-^71 . 


-i/7l . 


Multiplying, we get a system 


^12^2 d" ^13^3+ • • • + ^in^n ■— J/l» 

X2-\~ &23^3+ • • • + ^2n^n = 1/2, 

^3“l" • • • H '■ ^3n^n “ i/3, (^9) 


* ^71 — J/jl* 

Since the coefficients bij have been determined [see for- 
mula (4)1, we can calculate the values of the unknowns, 
beginning with the last one, using the following for- 
mulas: 

n 

»n = !/iv. ^i = yi— S »<«• (11) 

This method is known as Cholesky^s method (improved 
elimination method), in which the usual control with 
the aid of sums is employed. 

When we solve systems with the use of Cholesky’s 
method, it is eonvenient to use Table 3.11 and seek yi 
together with the coefficients fc,-. 



Table 3.11 


w 

00 -^CD (M 
^ CSI -c-» 

00 CM O CM 


Cons- 

tant 

terms 

VfCOMCO 

CM 

1 


•r 

H 

CM Vf 00 CO 

CM O 




1 

n 

H 

CO CM 

1 1 1 1 

1 1 


''H 

'(H 

1 

I 1 

CM 

1 

1 

5-1 

CM CO lO CO 

rM 

CO ^ 

1 1 



'CH 

1 

iH 

CM vr CM 


CM ^ CM 

1 

- 


<o <o <o «o 
iH Cl CO 'll 

Q Ct Cj CS 

«0 «D O «0 

*-• Cl CO 'll 

•-0 lO rO -O 


Constant 

terms 

lA to lO 

IH W CO 

a « C3 C3 

^ Cl eo ^ 

»0 rO 

II II II II 

iH <M to ^ 

2>» 5M 


H 

'll ^ 'll 

»H Cl CO 'll 

Q Q a a 



'» 

H 

'll 'll 'll 

»H d eo 

•O pO rO 

'll 

o' 

CO 

CO CO eo **9 

1-t d 00 ^ 

« a a cj 

eo CO 

pH d 

pO pO 

hH 


eo 

eo 

CO 

'll 

cc 

Cl 

« 

Cl Cl Cl M 
r-t M CO 'll 

a o a Q 


-- 


d 

d 

H 

d 

pO 

d d 

d eo 

H 

»H »-l iH 
iH ri CO 'C 

« CJ a a 

'CH 


t? 

r-l 

tj 

pH fl iH 

d CO 'O' 

o ej 


K-l 

»— 1 
l-H 

I-H 

l-H 

l-H 


1 ( 1-0104 
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Example. Using Gholesky’s method, solve the system 

' — 2^2 5X3 -|- = 3 , 

— 3^2 ^3 ”f” ^^4 3 , 

X-y-\~ 2 x 2 4X4= 3, 

, X1 — X2 — 4^:3 + 9x4 = 22. 

A The solution is given in Table 3.11. 

In the first section of the table we write the matrix of the coef- 
ficients, its constant terms and control sums. 

Tlien we fill in section II according to the rule indicated in 2.G, 
i.e. first find the first column of the matrix C, then the first row 
of the matrix the second column of the matrix the second 
row of the matrix B and so on. 

Section III is used to determine xi. 

The verification is done with the aid of the column 2 with which 
wc perform the same operations as with the column of constant 
terms. 

(1) Wo find the elements of the first column of the matrix C 
from the formula 


^ 2, 3, 4). 

Then we write the first column of section I into the first column 
of .section II: 

~ ^11 ~ 1 ? ^21 ~ ^21 " 2 , C31 — flg, -- 4 , r4i - ^41 - 2 . 

(2) We find the elements of the first row of the matrix B from 
the formula 

bij = flij/cii (/ 2, 3, 4, 5, 6), 


i.e. 

^12 ~ ^12^^11 “ 2, ^13 “ — 1, 

614 = ^14/^11 2, yj ~ = diJcii = 4, biQ ~ 

^16 ~ 1 ^12 “h ^13 “h ^14 "I" ~ 1 h 1 2 -|- 4 “ 8. 

(3) We find the elements of the second column of the matrix C 
from the formula 

~ ^i2 ^il^I2 2, 3, 4), 

i.e. 

^22 ~ ^22 ^21^12 ~ ^ 2*2 — 1, 

C32 “ ^^32 ^31^12 ~ 4*2 ~ 3, 

C42 ~ ^42 ^ 41^12 ~ 3 2*2 = 1. 

(4) We find the elements of the second row of the matrix B 
from the formula 


b^j - 


^2J 


/•__ 


(7-3, 4, 5, 6), 
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i.e. 


^23- 


^23 ^21^13 1 2- ( 1) 


— 1 


-1, 


b 

' - 


®24 ^21^14 ^ 2*2 


^0. 


C 22 1 

^25 — — 2*4 _ ^ 

' ‘ “ -~1 

^20 — ^21^10 14 — 2-8 

^22 1 

&26 = 1 I &23+&24^ ^25=1--1 I n-|-2-2. 


f/2 — h 
^^26 


2. 


(5) We find the elements of the third eoliinm of the nialrix 
C from the formula 

^in ^ii^i3 '■ ^1*2^23 U ~ ^)i 


^33 “ '*33 ■'’31^13 ■■ *^32^^23 ‘ ( — 1) “ ( ( “1) “ ‘ 2, 

^43 ■ **I3 ■” ^41^13 “ ^42^23 " "*( 1) ( 1)'( 1) ' ^• 

(G) We find the elements of the ihinl row of the matrix B from 
the formula 

*^33 


**34 *^31^^14 **32^*24 8 -- 4*2- ( 3) • • > 


Ih — ^35 — 


-2 

12 — 4.4-(-3)-2 _ 
— 2 


**33 

®36 **31^15 *^32^2ri 

*^33 

**36 *^ 31^16 — ** 32^26 ^G 4 » 8 - ( 3 ) ■ 2 

*^33 “ “ 

^*36 “ 1 “1" ^^34 "I ^*35 ~ 1 - “■• 1 ^ 




(71 We find the elements of the fourth column of the matrix C 
from the formula 


i.e. 


C44 a44 **41^14 **42^24 ^ **43^34^ 


C 44 - 3 - 2-2 - (-- 1).0 ^ 4.0 -- — 1 . 

( 8 ) We find the elements of the fourth row of the matrix B 
from the formula 


b^j = "*‘ 41 ^ 1 ; ~ *^42^2j~ *• 43 ^ 3 ; 


10 * 
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*^45 ^41^1.5 ^48^ari ^43^3.'i 


6-2-4-(-1).2-(-1)(-1) 


_ 12 — 2-8 — ( — 1)-2 — 4-(l ^ 

- — -A 

^' 46=1 + 645=1 + 1 = 2 . 

(9) Then wo calculate xi using the formula 
n 

^i = Ui— 2 2, 3, 4, 

where 1/1 ~ 4, j/ 2 ~ 2 , 1 / 3 = --1 and f /4 — 1. We h.ive 

^4 = !/4 = 1, 

^3 = ^3 — ^34^4 — 1 — 0*1 —1, 

Zj = ^2 — — ^ 24-^4 = 2 — (— 1 ) (— 1 ) 0-1 1 , 

Xi = yi — — &i4^4 = 4 — 2-i — (—1) (- 1) 

— 2-1 -■ - 1 . 


Xi =- —1, X2 = 1, X.f -= —1, X 4 " 1. A 

3.11. The Iterative Method (the Method of Successive 
Approxijiiations) 

Tile approAiniate methods for solving systems of linear 
equations make it possible to obtain the values of the 
roots of the system with the specilied accuracy as tlie 
limit of the sequence of some vectors. The process of 
constructing sucb a sequence is known as the ileratire 
process. 

The efficiency of tlie application of approximate meth- 
ods depojids on the choice of the initial vector aiid tlie 
rate of convergence of the process. 

In this section we consider the method of ileralioii 
(the method of successive approximations). Assume (hat 
we are gi^en n linear equations in n iinknowjis: 
r aiia;i4-fli2^2+ • • • +®in^7i ~ 

I 021^1 + ^22^2+ ••• H~®27l^n ^2> / /I \ 


®7il^l + ^n2^2+ ••• + flnn^n- 
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We write ayslciii (1) in matrix form: 

Ax — b, 


where 



Cl\\ ^ 1 2 • 

• ^171 


.I'l 


bi ~ 

. 1 - 

^21 '^22 ■ 

• ^271 


3:2 

, b 

f^2 


(ln\ ^Tl'i • 

■ • ^7171 




_^7l_ 


C^) 


Assuming that the diagojial elements fitt ^ 0 (i -= 
1, 2, . . n), we express X, using the lirst equation of the 

system, x.,, using the second equation and so on. As a 
result we get a system equivalent to systejn (1): 



«12 . 

0*2 

rill 

7Z|3 

. .—^x, 

«ll 

fill ' 

flu ' 





7/22 

- X, - 

a,2 ' 

7/22 

- - X , 

ri j2 

Al_ 

.^ILL r. — 

^n2 

'0) .71-1 ^ 

^hin 

- - .Vi — 

«7l7l 


^nn 


We ilesignate ^ a,;, where i — 

1, 2, . . 7 1,2,...,//. Then we can write system 

(2) as follows: 

^1 ~~ P I “I" h ‘ I ' • • • “I ' 11'^' ni 

‘t'*2-"p2-|-a2e^l 1 a23-L-|T •••-!- 

' ( 3 ') 

— Pn ! 1 ^7?2^2d~ • • • “h ^71. 


System (2') is known as a system reduced to the norniul 
for/ii. Introducing the designations 



an 

ai. ., 

. . ain 


'Pi‘ 

a ' 

a.,1 

0^22 • • 

• ^271 

. P-= 



.. 

2 ■ 

• • a7i/i_^ 


Pn . 


we write system (2') in matrix foriu: 

x = p + ax, 
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or 


“Xi 


•Pi ■ 


^2 

= 

P2 

+ 

- - 





ail 

^21 


a 


12 

>^22 




a.,. 


a«i a„ 


.ri 


( 4 ) 


Wo use the inoUiod of successive approximations to 
solve system (4). For the zeroth approxiiiialioii wc take 
the 'olumii of constant terms: 


is the zeroth approximation. 


■xio> “ 


'Pi ■ 

x<0> 


P 2 

0) 

L_‘‘'n _I 


_Pn. 


Then we construct a column matrix 


1-1' >1 


"Pi n 


ail 

ai2 • 





= 

Pa 

+ 

^21 

a22 

. . a27i 


r(0) 

jr.i 

r(0 

'* n J 


— Pn 


_ ^rn 

^nz • 

• • ann__ 


r(0) 

_** IL —1 



“Pi " 


an 

a , 2 . 

. . am ' 



2) 

= 

P 2 

1 - 

^21 

a^.j • ■ 

• • 0^271 



A2 ) 
n -J 


-Pn — 


C3Cni 

• ' 

■ • CC/iri ^ 


7.(1) 

L •*'71 J 


is the first 
approxima- 
tion, 


is the second 
approxima- 
tion, 


and so on. 

In general, any (k + l)th approximation can he cal- 
culated by the formula 

- P -I axW (/r - 0, 1, . . ., //). (f)) 


If the sequence of approximation x(®>, x^^) , . . has 

a limit x — Um then this limit is a solution of 

/l->oo 

system (3) since, by virtue of the property of the limit 
Jirn = P 1- a lim x^^>, i.e. x — a n- Px. 

x->oo h-^-OO 

Example 1 . Solve the system 

< a:i + 5x2 — 3-3 = 7, 

t Xj — Xg-f 5 x 3 - 7 

with an accuracy of 10"^ using the iterative method. 
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A (1) Wo reduce the system to normal form 

— 0 . — 0 . 125 x 3 , 

^2= 1 .4 — 0.2xi-1-0.2x3, 

X3 — 1.4 — 0.2x1 + 0.2x3; 

0 ~().125 —0.125 

a— I — 0.2 0 i ».2 

- 0.2 0.2 0 

1 3.25 I 
1.4 
1.4 


(2) Wo construct successive approximations. The zeroth approx- 
imation is 




3.25 

r (0) 
'*2 


1.4 

r ( 0) 

L-x 3 * 


1.4 - 


The first approximation is 


r< i) 

1 


r3.25i 


0 

-0.125 

-O.J25 



1.4 

-h 

— 0.2 

0 

0.2 



1.4 . 


. -0.2 

0.2 

0 



3.25 


2.9 

X 

1.4 


1 .03 


1.4 - 


1.03- 


The second approximation is 


Al) 

1 

1 

3.25n 


0 - 0.125 0.125 

1 1 

1 2.9 1 

1 j 2.992- 




1.4 

-I'l 

— 0.2 0 0.2 

1 

1 .03 

. 026 

4-” 


-1.4 - 


— 0.2 0.2 0 

1 1 

1 1 .03 

1 li.(^2G- 


The third ap[)rnximatioii is 




3.25 1 




1.4 

-1 

.7+>- 


Li.4 



— 0.125 - 0.125 

0 0.2 

0.2 0 



2.992 


2.99 


1 .(^26 


1.01 


1 .026- 


1 1.01 


Thus xi = 2.90, .rg = 1.01, X;, - l.Ol, and, with an accuracy 
(d' 10”^, we obtain .Tj - 3.0, x^ ^ 1.0, X;, 1.0. ^ 

Example 2. Solve the system 


7.().ri-| O. 5 .T.J-I 2 .4.r., -- 1 .0, 

2.2xi 1 9 .IX 2 -I- 4 . 4 X 3 --9.7, (*) 

- 1.3xi ! tK2x2-t 5. 8.7*3 -- - 1.4. 


with an accuracy of 10^“ using the iterative method. 
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A (1) Wo reduce the system to normal form: 



1.9 

0.5 

2.4 

Xi = 

7.6 

■7.6 

7.6®*” 


9.7 

2.2 

4.4 

X2 = 

9.1 

9.1*^“ 



-1.4 

,1.3 

0.2 

Xg = 

5.8 

+5.8''* 

5.8 


f = 0.25 — 0 .065a:2 — 0.3158a:3, 

or i 3-2=1.0659 — 0.2418x1 — 0.4847a:2, 

I X3= —0.2414-1-0.2241x1—0.3448x2; 



r ^ 

— 0.065 

—0.3158- 

- 

a = 

— 0.2418 

0 

— 0.4847 



- 0.2241 

— 0.3448 

0 



0.25 

— 0.0659 

— 0.2414 


Note that we can also do the following to reduce a linear system 
to normal form: wo write the coefficients of x,, Xg, Xg in the corre- 
sponding equations of system (♦) in the form kx, where k is a number 
close to the coefficient of the respective unknown and by which it 
is easy to divide the coefficients of the unknowns and constant terms. 
For example, 

lOxi = 7.6xi -|- 2.4xi (in the first equation), 
lOxg = 9.1x2 -f 0.9xa the second equation), 
lOxg = 5.8x3 +%4. 2x3 (in the third equation). 

We rewrite system (*) as follows: 

f' l()a:j = 1 . 9 -|- 2 . 4 xi — 0 .6x2 — 2.4x3, 

< 10x2 = 9.7 — 2 . 2 xi 4 - 0 . 9 x 2 — 4.4x3, 

t 103:3= — 1 .4-f-l .3xi — 0.2x2 + 4. 2x3, 
f a:i = 0.194-0.24x1 — 0.05x2 — 0 .24x3, 
i X2 = 0 .97 — 0.22x1 + 0 .09x3 — 0 .44x3, 

[ xs= — 0.144-0.13x1 — 0.02 x 24-^>. 42x3. 


The matrix a and the vector p assume the form 



r 0.24 

— 0.05 

— 0.24 1 


r 

a = 

— 0.22 

0.09 

— 0.44 

1 



- 0.13 

— 0.02 

0.42 _ 




0.19 

0.97 

-0.14J 


(2) We find in succession that 




Ch. 3. Solving Systems of Linear Equations 


153 



— 0.05 —0.24 
0.09 —0.44 

— 0.02 0.42 



0.2207- 

1.0771 

-0.1935- 


0.2359 

1.1034 

-0.2141 


0.24 
— 0.22 
0.13 


0.09 —0.44 


Thus, with an accuracy of 10’^, we obtain 

Xi — 0.236, X2 ~ 1.103, ^3 ~ — 0.214. 

3.12. Thf ^^nditioiis for Convergence of an Iterative 
Process 

CoJisider a syslojii of linear equal ioJis reduced lo nor- 
mal form: x = (i 1- ax. The conditioj) for cojivergeiicc 
of an iterative process consists in the following: ij the 
sum of the moduli of the elements of the rows or the sum of 
the moduli of the elements of the columns, is .smaller than 
unity, then the iterative process for the given system reduces to 
a unique. so lilt ion irrespective of the choice of the initial vector. 

Consequently, we can write the condition for cojiver- 
gence as follows: 

n 

s lcx,^| < 1 (t- I, 2, . . n) or 

j=i 

ij la/;l <1 (/ - - 1. • • •. «)• 

i— 1 

Example. For the system 

r Sj-'i-I .r2-|-a’3--26, ( .r^ 3 .25 — 0 . 125^. - 0.125./.,, 

< x^-|- 5^2 — 0:3 — 7, or < 0 * 2 — 1 .4 — 0 .2.ri +o. 2 a\.^, 

I xi~-X2-\-^x^-r-7^ [ j- 3 :^- 1 .4 — O. 2 .T 1 H O. 2 .T 2 , 

the iteration process converges since 

r 0 - 0.125 — 0 . 125-1 

— 0.2 0 0.2 

- — 0.2 0.2 0 
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and 

I an l + l a2i I + Ia3il=0.2+<).2 = 0.4<1; 

I aia I -h I a^a I + I a32 I =0.1254-0.2 = 0.325 < 1; 

I ai 3 I “1 - 1 (X 23 1 -\- 1 OC 33 1=0. 125 -[-0.2 = 0. 325 <C 1 . 

By analogy, wo can verify the fulfillment of the condition for 
convergence taking the sums of the moduli of the elements of the 
rows. 

The iterative process obviously converges if the elements of the 
mati ix a satisfy the inequality | a^j | < 1/n, where n is the number 
of the unknowns of the system. In this example ai = 3 and all the 
elements | a,y | < 1/3. 

The convergence of an iterative process is reJaled to 
the norms of the matrix a as follows. If one of the condi- 
tions 

n 

II all, -max S l«/;l< 1 

i 

or 


n 

||a||2 -=max 2 
} j=i 



is fulfilled^ then the process of iteration of the linear system 
converges to a unique solution. 

Thus, in the example considered above, the norm 

II alia = max (0.4, 0.325, 0.325) = 0.4 < 1, 
i.e. the iterative process converges. 

3.13. Estimation of the Error of the Approximate 
Process of the Iterative Method 

If the permissible error e of calculations is specilied 
and Xj is the vector of the exact values of the unknowns 
of a linear system and is the kih approximation of 
the values of the unknowns calculated with the use of 
the iterative method, then, to estimate the error 
II Xj — II ^ e t)f lliQ method, ;use is made of the 
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Avlicrc II a II is oiio of the three norms of the matrix a, 
II P II is the same norm of the vector p and k is the number 
of iterations needed to attain the specibed accuracy. In 
this case we assume tliat tJie successive approximations 
(wliere / = 0, 1, . , k, i = i, 2, . . n) are cal- 
culated exactly, without the round-off errors. 

Example. Show that for the system 

( {)A)xi — 1 .5^:2 + 2.62:3=: 0, 

< 0.4x1-1-13.62:2 — 4. 2x3: -8. 2, 

[ 0.7xi-l-0.4x2d-7.1x3= —1.3 

the iterative process converges and find out how many iterations 
must ho ciuTi. i’. out to find the unknowns with an accuracy of 10”*. 
A (1) We reduce the system to normal form 

f 1 Ox I — 0 . 1 2: 1 -j- 1 . 52‘2 — 2 . 6.i- , 

} 20x.2----0.4xi-l-6.4x.2-l-4.2x3 | 8.2, 

[ 10x3--= — 0.7xi — O.4X2-I-2.OX3 — 1 .3, 
or 

{ xi =-0.01xi |-0.15 x.2 — 0.26x3, 

x.2= — 0.02xi-f0. 32 x.2 - 1-0.21x3 -f- 0.41, 

X.J — — 0 .( ) 7 xi — 0 . < ) 4 x .2 0 . 20x3 — 0 . 13 . 

(2) The system matrix 

- o.oi 0.15 —1^26 -I 

a= — (».02 0.32 0.21 . 

. —0.07 —0.04 0.29 - 

Using the norm || a II2 we get || a \\^ = max (0.1, 0.51, 0.76) - - 

0.76 < 1. Consequently, for this system the iterative process con- 
verges. 

- 0 -I 

(3) We have p= 0.4I , || P II2 -- 0 -|-0 .41 '’.51. 

-—0.13 - 

(4) Using formula (1), we find that 

l|a|l2'"‘-llPll2 ii.76'<+i-i1.54 
II X II ^ , 16 < 

10-*. 40 

0.70ft+‘-o.54i^ 10->.0.40; o.70/»»i< ^ , 
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(* + 1) log I ) .76 < log 46 - log 54-4, 

- (fc + 1) • 0.1 192 < 1 .6628 - 1 . 7324 - 2 = - 4 .(1096, 

fc+l> o'S ""32.9. A;>32.9, k = d3. 

Tho theoretical estimate of the number of iterations necessary to 
ensure tho specified accuracy proves to be too high in practice. ^ 

3.1^. Seidel’s Method. The Conditions for Convergence 
of Seidel’s Process 

Seidel’s method is a inodilication of tho iricthod of 
successive approximations. When calculating llio 
(k l)tli approximation of the unknown Xi (i > 1) J)y 
Seidel’s method, we must take into account the k approx- 
imations of the unknowns Xi, fouFid before. 

Consider a linear system reduced to normal form 

^i^^Pi + ocn^i + ai2^2+ • • • 

^2 ~ P 2 "h + 0C22‘T?2 + • • • 'h ^2n^n i 

j-jj =: P 3 -|- 0C3ja:i-|- a32^2“l" • • • ( 1 ) 

^n~Pn’l ®ni^l ^^712^2"!" • • • “1" 

We arbitrarily choose the initial approximations of the 
unknowns J:’n^ and suJ)stitute them into 

the first equation of system (1): 

= -1- -f ... I- 

We siihstitute the first approximation into tln^ second 
equation of system (1): 

^ 2 '^ + ... I 

Then we substitute the first approximations .Cj" and 
into the third equation of system (1): 

and so on. Finally we have 

••• I a,i, I «»«•'»” 

By analogy we construct Ihe second, tiie third, etc. 
iterations. 
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Thus, assuming that the /ith approximations x'i are 
known, we use Seidel’s method to construct the {k + l)th 
approximations by the following formulas: 


I f S a„x?', 

i=2 


I 1) 

'*'11 


n-i 


Pn-I- S 






ih) 


i— 1 


whoro 1, 2, 


Example 1. Use SeideUs method to solve the system 
r 7 . Gt, - 1-0. 5^*2 I- 2. 4x3 --1.0, 

< 2.2 jii-| 9.1.r2-|-4.4T3=-.9.7, 

I — 1.3a:i I l».2ar2 l 5.8.2:3--= — 1.4 

with an accuracy of 10“^. 

A (1) We reduce the system to normal ^)riTi: 

f I0:rx-- 1 .0-1-2. 4.ri — 0. 5x0 — 2. 4.1-3, 

} 1 0 .r 2 -- 0 . 7 — 2 . 2 r 1 1 - 0 . 0 .r 2 -- 4 . 4 X 3 , 

[ 10:r3-- — 1.4-hl..3.r,- 0.2x0 | 4.2.r3, 
or 

f Xi~ 0.10-1-0.24x1—0.05x2 '0.24.r3, 

< xo 0.07—0. 22xi - 1 - 0 .UOxo — 0 . 44 x 3 , 

I .r^-- -0. 14-1-0. 1,3.ri — 0.02.r^i-0.42.r3. 

(2) For the zeroth approximations we lake the corresponding 
values of constant terms: x(J) 0.19, .r(§) = O.07, x(§) — —0.14. 

(3) We construct iterations using Seidel’s method. The lirst 
approximations are 

x(|) 0.19 -I- 0.24.0.19 — 0.05.0.97 — 0.24- (-0.14) = 0.2207, 

x(J) =- 0.97 — 0.22-0.2207 + 0.09.0.97 — 0.44. (—0.14) -- 1.0703^ 
xit) r-- —0.14 + 0.13.0.2207 — 0.02.1.0703 -|- 0.42. (-0.14) 

- -0.1915. 

The second approximations are 
xij) -- 0.19 I- 0.24-0.2207 — 0.05-1.0703 - ’).24. (-0.1 015) 

- 0.2354, 

x(l> -- 0.97 — 0.22-0.2354 + 0.09-1.0703 — 0.44- (—0.1915) 
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= 1.0988, 

= -0.14 + 0.13.0.2354 - 0.02.1.0988 + 0.42- (-0.1915) 

-= -0.2118 
and so on. 

The solution of this example is given in Table 3.12. The con- 
struction of iterations is completed when we get the same values 
in two successive iterations with the specified degree of accuracy. 
In this example these are iterations 7 and 8. 

The final answer is Xi ^ 0.248, ^ 1.114, ^ —0.224. ^ 

Table 3.J2 


No. of 
iteration 

■ 

■ 


No. of 
Iteration 


.Y2 

X‘\ 

0 

0.10 

0.97 

-0.14 


0.2467 

1.1138 


1 

0.2207 

1.0703 

-0.1915 


0.2472 

1.1143 


2 

0.2354 

1.0088 

-0.2118 

H 

0.2474 

1.1145 

-0.2243 

3 

0.2424 

. 1.1088 

-0.2196 

8 

0.2475 

1.1145 

-0.2243 

4 

0.2454 

1.1124 

-(1.2226 






For the linear system x = (5 ax Seidel’s process 
(as well as the process of sncce.ssivo approximations) 
conuerf^es to a unlqjie solution for any choice of the initial 
approximation if at least one of the norms of the matrix a is 
smaller than unity ^ i.e. if 

n 

II a 11, --max S ja/yKI 

I j - 1 

or 

11 

l|a|| 3 -= max S |a,.^I<l, 

} i-1 

or 

Halls -- 1/^S lauP<'l. 

r 1, j 

SeideF^i process converges to a niiiqne solution faster 
tJian the process of a simple iteration. 

Example 2. Verify whether Seidel’s process converges for the 
system considered in Example 1. 
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A (1) After reducing the system to normal form (see p. 157), 
we get a matrix 


a = 


0.24 --0.05 — 0.24-| 
— 0.22 0.09 0.44 

0.13 —0.02 0.42- 


(2) We find that ||a||i = max2 loCijl — max (0.53, 0.75, 0.57) — 
^ j 

0.75 <1. Consequently, for this system the iteration process con- 
verges to a unique solution despite tlic fact that Hallo — 

n 

max 2 1 1 —max (0.59, 0.16, 1.1)= 1.1 >1.^ 

i t=i 


3.15. Estimation of the Errors of Seidel’s Process 

Consider a linear system x == P -] ax. If xi is the exact 
value of the unknowns of the linear system and x<^> is 
the kill approximation calculated by Seidel’s method, 
then, to calculate the error of this method, use is made 
of the formula 

||x(‘)-xW||,. (1) 

Example. Find how many iterations Seidel’s method requires 
to find a solution of the system 

f 9.93:1 — 1.5^2-1-2.6x3 = 0, 

< 0.4x1 + 13.6x2 — 4.2x3 = 8.2, 

{ 0.7xi + 0. 4x2 + 7. 1x3= —1.3, 

with an accuracy of 10'^. 

A (1) We reduce the system to normal form (see p. 155): 

r j-j — 0 .Olxi l- 0 . 15 x 2 — 0.26x3, 

< X2 = 0.41—0 .02xi + 0.32x2 + 0.21x3, 
i X3= -0.13-0.07x1-0.04x2-1-0.29x3. 

(2) For the zeroth approximations we take the column of con- 
stant terms .tCJ) = 0, x(S) = 0.41, xl?) — —0.13 and calculate the 
hrst approximations: 

xi* > =r 0 .01 .0 -1-0.15-0 .41 —0.26- ( — 0.13) = 0 .0953, 

x<‘ > = 0.41 -0.02-0.0953 + 0.32-0.41 +0.21 ‘ (-0.13) = 0 .5120, 

a:U) == -0.13-0. 07-0.0953-0.04-0. 5120-1 0.29- (-0.13) 
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(3) The matrix 

a — 


0.01 0.15 —0.26-1 

— 0.02 0.32 0.21 

__0.07 —0.04 0.29- 


This means that || a ||i = max (0.42, 0.55, 0.40) - 0.55. Since 



r 0 - 

r 0.0953 -1 

x(0)-- 

0.41 

and xO)= 0.5120 


-—0.13 

L— 0.1948- 


we have 


x(i)-x(0)- 


i). 0953-1 
0.1120 
— 0.0648. 


i.e. II xO)-x(O) 111-- 0.1120. 


(4) We find k from formula (1): 

0 

-O.Ha), 10-1.0.45 <i).55ft-(). 1120 

0.45 


— 4 log 10 -I- log 0 .45 < * log 0.55 + log 0 .1120, 
-4-0.3468</c(-0.2506-0.9508), * > x|j^=3.59, fc = 4. 
By analogy we can estimate Seidel’s method using the norm 

II « IL- ▲ 


3.16. Reducing a System of Linear Equations to a Form 
Convenient for Iterations 

For the linear system x = (i + ax the process of 
successive appro.vimations and Seidel’s process converge 
to a unique solution irrespective of the choice of the 
initial vector if 

n 

S |a/jl < 1 (j=- 1, 2, . . ., n) or 

j=l 

il la.-il <1 2, .... ra). 

i-1 

Thus, for these iterative processes to converge, it is 
sufficient that the values of the elements a^j of the matrix 

a, for i /, be not very large in absolute value. This is 
equivalent to the fact that if, for the linear system Ax = 

b, the moduli of the diagonal coefficients of each equation 
of the system are larger than the sum of the moduli of 
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all other coefficients (not counting the constant terms), 
then the iterative processes converge for this system, i.e. 

n 

if we have a system 2 (i = 1, 2, . . n), 

3=i 

with 1 fliH > 2 \ process of successive 

approximations and SeideTs process converge for this 
system . 

Using elementary transformations, we can replace the 
linear system ^Ix -- b by the equivalent system x = 
P + ^or which tlie conditions of convergence are 
fulfilled. 

Example. Reduco the system of linear equations 

r 0.9Ti + 2.7j:a — 3.80:3=2.4, (A) 

^ 2.5x1-1-5.80:2 — 0. 5x3 = 3. 5, (B) 

t. 4.5xi — 2. 1x2 + 3. 2x3 = — 1.2 (C) 

to a form convenient for iterations. 

A (1) From this system we isolate the equations with coeffi- 
cients whose moduli are larger than the sum of the moduli of the 
other coefficients of the system. We write every isolated equation 
as a row of the new system so that the coefficient, which is the 
largest in absolute value, would be diagonal. 

In equation (B) the coefficient of Xa is larger in absolute value 
than the sum of tne moduli of the other coefficients. We assume 
equation (B) to be the second equation of the new system: 

2 . 5 xi + 5.8x2 — 0.5x3 = 3 - 5 . (II) 

(2) From the remaining equations of the system we compose 
linearly independent combinations. Thus, we can take the linear 
combination (2C) + (A) as the first equation of the system, and 
then we have 

9.9xi — 1.5x2 + 2.6x3 “ (1) 

As the third equation of the new system we can take the linear 
combination (2A) — (B), i.e. 

0.7xi + 0.4x2 + 7.1x3 = -f-3. (HI) 

(3) As a result we obtain a transformed system of linear equa- 
tions (I), (II), (III) which is equivalent to the initial system and 
satisfies the conditions of convergence of the iteration process: 

f 9.9xi — 1.5xa + 2.6x3 = 0, 

< 2.5xi + 5.8x.2 — 0.6x3 = 3.5, 

I 0.7xi+ 0.4x2 + 7.^8= -1.3. 


11-0104 



162 


Computational Mathematics 


Reducing this system to normal form, we have 
r a:i =0.13:1 + 0.15x2 — 0.26x3, 

< X2 = 0.35xi — 0.21x2+0.42x3 + 0.05 
[ 0:3== —0.13x1 — 0.07x2 — 0.04x3 + 0.29, 

■ 0.10 0.15 —0.20“ 

a -= 0.35 —0.21 0.42 ; 

_-0.13 —0.07 — O.04J 
II a II2 = max (0.58; 0.43; 0.72) = 0.72 < 1. 

i t remains to solve the system using one of the iterative meth- 
ods. 

Exercises 

1. Solve the following homogeneous systems of equations: 

(a) r Xi -|- 3 x2 + 2x 3 = 0, (h) r 3 xi+ 4x3— 5x3+ 7 xi = 0, 

I 2xi — X2 + 3x3 = 0, I 2xi — 3x2+ 8x3 — 2x4=0, 

I 3xi — 5x2 + 4xg = 0 , I 4xi-1-11x2 — 13 x 3 + 16 x 4 = 0 , 

V Xi + 17x2 + 4x3 = 0; ^ 7xi — 2x3+ X3+ 3x4 = 0. 

2. Test the following systems of equations for consistence and 
find its general solution and one special solution; 

(a) f 2 xi + 7 x 2 + 3 x 3+ X4 = 6, (b) r 2xi — 3x3+ 8x3+ 7x4 = 1, 

< 3 xi + 5x2 + 2x3 + 2x4 = 4 , < 4 xi — 6x2+ 2x3+ 3x4 = 2, 

I 9xi + 4x2+ X3 + 7x 4 = 2; t 2 xi — 3x2 — 11x3—15x4 = 1. 

3. Use Cramer’s formulas to solve the following systems of 
linear equations: 

(a) C 2xi+ X2 + 4x 3 = 7, (b) f llx + 3f/— 2 = 15, 

< 2xi — X2 — X3 = — 5, < 2x + 5r/ + 5z= — 11, 

I 3xi + 4 x 2 — 5x3= — 14; I x+ //+ z = l. 

4. Use Gaussian elimination method to solve the following 
systems: 

(a) f xj — 4x2 — ^4 = 0, (h) f 2xi — Xg — 2x4=— 8, 

I xi+ X2 + 2X3 + 3X4--- — 1, j X2 + 2X3— X4=— 1, 

I 2xi + 3x 2— Xg— X4 =— 1, 1 Xi— Xg— X 4 =— 0, 

^ X4 + 2X2 + 3X3— X4 = 3; V — 2x3 = 7. 

5. Use Gaussian elimination method to solve the following 
systems with an accuracy of 0.001: 

(a) C 1.14xi — 2.15x2 — 5.11x3 = 2.05, 

< 0.42xi - 1 . 13x2 + 7.05x3 = 0.80, 

I —0.71x1 + 0.81x2— 0.02x3= —1.07, 

(b) r 0.61x+0.71y-0.05z= — 0.10 

} — 1.03x — 2.05y+0.87z = 0.50, 

[ 2.5x — 3. 12y + 5.032 = 0.95. 
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6. Use Gaussian elimination method to calculate the determi- 
nants: 


(a) d = 


7. Use Gaussian elimination method to invert the following 
matrices: 


1 

4 1 

3 

-1.6 

5.4 

-7.7 

3.1 

0 

— 1 3 


8.2 

1.4 

-2.3 

0.2 

3 

1 0 

2 , (b) d = 

5.3 

-5.9 

2.7 

— 7.9 

1 

-2 5 

1 

0.7 

1.9 

-8.5 

4.8 


(a) A=^ 


12 2 -1 
2 7 6 —1 
0 3 1 4 

0 1 — 1 


0.32 0.52 —0.42 0.23 

0.44 —0.25 0.36 —0.51 

— 1.06 0.74 —0.83 0.48 

0.96 0.82 0.55 0.36J 


Carry out the calculations to three decimal places and round off 
the answer to two decimal digits. 

8. Use the method of successive approximations to solve the 
following systems of linear equations with an accuracy of 0.01, 
first determining the necessary number of iterations: 

(a; r 8.7x1 — 3.1x2H-1.8x3 — 2.2x4— — 9.7, 

I 2.1xi -[-6.7X2 — 2.2x3 =13.1, 

I 3.2xi — 1.8x2 — 9.5x3 — 1.9x4 = 6.9, 

V 1.2xiH-2.8x 2 — 1.4x3 — 9.9x4 = 25.1, 

(b) f 6.1x-l-0.7y — O.05z = 6.97, 

\ — 1.3x— 2.05y + 0.87z = 0.10, 

[ 2.5x — 3. 12i/ — 5.03z = 2.04. 

9. Use Seidel’s method to solve the systems of linear equations 
given in Exercise 8, first determining the necessary number of 
iterations. 

10. For the matrices 


-0.3 

1.2 - 

-0.2' 

ro.2 

0.44 0.81 

-0.1 

— 0.2 

1.6 

, (b) A= 0.58 

— 0.29 0.05 

— 1.5 

— 0.3 

0 .1. 

L0.05 

0.34 0.1 


calculate the norms || ^4 ||i, || .4 \\^ and || 4 II3. 

11. Use the method of pivotal condensation to solve the follow- 
ing systems: 

(a) 3^1 — 2x2 — 5x3 -f X4 = — 5, 

2x 1 3X2 ”1“ ^3 “i~ 53?4 = 7 , 

Xi + 2 X 2 — 4 X 4 =— 1, 

Xj^— X 2 3 X 3 — 9J'4 — — * 4, 

(b) 4xi — 3 x2 4“ ^3 — 5X4 = 7, 

7xi — 2x3 — 3x3 — 2x4 = 6, 

3 xi — 2x2 + 5x3 — 2x4 = 0, 
2xi4-3x2-1-5x3-|-4x4 = — 5. 


11 * 
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12. Use Gholesky*s scheme to solve the following systems of 
linear equations: 


a) 


r *1+2*2 +3*8 +4*4 = 5, 

(b) ] 

J 2*1+ *2 +2*3+ 3*4 = 1, 

1 3 *i+ 2*2+ *8+2*4 = 1, 

i 

4 *i+ 3*2+2*8+ 2:4=— 5; 

V 


Xi -{- 2^72 " 4 " 3^8 — 

2 xi+ *2 + 23:3=1, 
3*1 + 2*2+ 3:, = 4. 



Chapter 4 


Calculating the Values 
of Elementary Functions 


In calculations we often encounter the problem of 
finding the values of a function at a specified point. In 
that case we must bear in mind that mathematically 
equivalent expressions not always prove to be of the 
same value when they are calculated. For example, to 
calculate the left-hand side of the identity 

4- 2ab 4- 4- hf, 

we have perform four operations of multiplication and 
two operations of addition, and to calculate its right-hand 
side, we have to make only one addition and one multi- 
plication. 

Thus we arrive at <*? significant problem of representing 
a function in optimal form in order to construct the algo- 
rithm of calculation of its values. Wo can understand the 
optimality in the sense of minimization of either the 
total number of arithmetic operations or^the time needed 
to calculate the values of the function. 

4.1. Calculating the Values of Algebraic Polynomials 

An algebraic polynomial of degree n is an expression 
of the form 

P{x)^ aoa:”-f-ai.r^"*4- . . . 4-a„_ij:4-fln» (^) 

where the coefficients . . ., are real numbers and 

flo is assumed to be nonzero. The coefficient is a constant 
term of polynomial (1). 

The calculation of the values of an algebraic polynomial 
is a typical example of minimization of the number of 
computing operations. This problem is important in 
practical applications not only in Hs direct sense but 
also because it is closely conneciod with the problem of 
division of a polynomial by a linear binomial (a first- 
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degree polynomial), i.e. with the problem of finding the 
roots of a polynomial. 

A root (a zero) of polynomial (1) is every number ^ 
which turns this polyjiomial into zero when ^ is sub- 
stituted for X in the polynomial, i.e. P (^) = 0. 

The root ^ of polynomial (1) is a root of multiplicity s 
(or an s-multiple root) if the polynomial itself and all of 
its derivatives up to the order .s’ — 1 vanish at the point 
;r ~ 5 and the 5th derivative docs not vanish at that 
point: 

P il) P'(l)-^^...- (I), il) ^ 0. 

If the root of a polynomial is of multiplicity 5 = 1, then 
it is a simple root. 

Example 1. Determine the multiplicity of the root x = —2 
of the polynomial 

p (jc) = -f- Ix^ + 18a:2 + 20x + 8. 

A We seek the first derivative P' (x) = 4 j:® + 21x2 + 36x + 

20 and calculate P' (—2) = 0. Then we find the second derivative 
P" (x) = 12x2 + 42x + 36. Wo have P" (—2) = 0. Next wo find 
the third derivative P'"(x) = 24x 42. We have P'" (—2) = 

— 6 ^ 0 . 

Thus the polynomial itself as well as its first and second deriva- 
tives vanish at the point x=— 2 whereas its third derivative is 
nonzero at that point. This means that the root ^ — 2 has multi- 

plicity 5 = 3. 

The principal properties of the roots of an algebraic 
polynomial are presented in 5.8. 

Consider the problem of calculating polynomial (1) 
at a point x = x*. To solve this problem, we represent 
the polynomial in the form 

(•^) ^ {^n -2 (^1 

-H xuq) ...)). ( 2 ) 

To find the value of P^ (a;*), wo calculate, in succes- 
sion, 

^1 = 

^2 




(3) 
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Wc can see from the expressions for bi that every successive 
coefficient 6/ results from the addition of the correspond- 
ing coefficient ai to the product of the predecessor b/.i 
by X*. 

Wlien calculating Pj^ (x*) and the coeflicients 6^, 
without using a computer it is convenient to use the fol- 
lowing table: 


Table 4.1 







«n-i 

(iji 


1*60 

x*hY 

x*b2 


^*bn-2 

x*bn^i 

K 

6, 

h; 

^3 


&n-i 

bn 


In the first row we write the coefficients of the polyno- 
mial {x) (we wTito the negative coefficients with the 
minus sign and omit the plus sign before the positive 
cocfficienLs). We immediately transfer to the 

third row. Then we multiply every coefficient hi by x^ 
and write the result under the next coefficient f i. We 
sum up the numhers in the first and the second row and 
write the result bi+\ in the third row^ 

By virtue of the construction of the calculation ^^rocess 
it is evident lliat = P (.i*). 

It is easy to calculate the number of operations needed 
to liiid P (x*): with the use of formula (1) w(‘ must per- 
form 2n — 1 multiplications and n additions and with 
the use of formula (2) we must make m additions and n 
multiplications. 

TJuis formula (2) makes it possible to economize and 
almost half the number of multiplications. And if we 
take into consideration the fact tliat the operation of 
multiplication requires much more time than the opera- 
tion of addition, we see that the use of calculating scheme 
(2) is rather eflicient. 

Scheme (2) is known as Horner's scheme. 
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Example 1. Using Horner's scheme, calculate the value of the 
polynomial (x) = — 2 .t* + a:® — a: + 1 for a: = 3. 

A We construct Hornor’s scheme for this polynomial: 


1 

3 

-2 

1 

-1 

1 


3 

18 

48 

147 

438 

1 

6 

16 

49 

146 

439 = Ps(3) 


Thus P 5 (3) = 439. A 

It turns out that when realizing Horner’s scheme wo 
not only calculate ~ Pj^ (x*) but also Find the coef- 
ficients bi (i = 0 , 1 , . . n — 1 ) of the polynomial 

{X) + . . . + fc„-, , (4) 

which is the quotient of the division of the polynomial 
Pn (^) by the binomial x — x*: 

P„ (X) ^-{x- X*) (X) + (z*). (5) 

Indeed, removing the brackets on the right-hand side 
of relation (5), collecting terms and taking into account 
that PJ^ (x*) — 67 ,, we obtain 

Pr, (x)^- boX^ + {fh - -I- {b, ~ x*b,) x^-^ 

-!-•••+ (^n-1 —^*bn-z) X + bn — X*bn.i. 
From this we have 

Ui- 

which is in complete accord with relations (3) and thus 
proves representation (5). 

We thus arrive at the following theorem. 

Bezout’s theorem. The remainder of the division of the 
polynomial P^ (x) by the binomial x — 3 ;* is equal to the 
value of the polynomial for x = x*. 
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Example 2. Calculate the value of the polynomial P 4 (x) == 
+ 19®* — 4 at the point = — 2 and determine the coeffi- 
cients of the polynomial PC}) (®) which is the quotient of the divi- 
sion of P 4 (x) by the binomial ® + 2 . 

A We construct Homer’s scheme for the polynomial: 


12 

19 

0 

0 

-4 


—24 

10 

-20 

40 

12 

-5 

10 

i 

-20 

36 


Thus P 4 (-2) = 36 and P(*) (x) - 12®* - 5®* + 10® - 20. ^ 

Another example of Ihe use of Horner’s scheme is a 
change of variable in a polynomial. 

Assume Ih.*! in polynomial (1) we have to pass to a new 
variable y which is in a linear relationship with the vari- 
able x: X == y + or y = X — j:*. 

This means that wo have to find the coefficients of the 
polynomial 

Pn (?/ -1- X*) --- ^ iy""‘ +... + A „_,,V + . (6) 

Wo can show that 

An^ Pn{x*), 

An-i pi:\(x*), 

(X*), 


where is (lie given polynomial (1) and Ihe other 

polynomials 

P^nlk (x) - d- + . . . 4- 

{k^ 1 , 2 , 

are defined by the relations 

/>„ (X) ^ (X - X*) (X) + Pn {X*), 

n*’, (X) = (X- X*) (X) + (X*). 


/>;»-»> (a;) = (X- X*) + P”"*’ (x*). 
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Thus we get the following simple algorithm for finding 
A] {] = n, n — i, . . 1 , 0 ): 

1®. Using Horner’s scheme, we calculate the coefficient 
An = Pn (^*) s^lso the coefficients (i == 0, 1, . . 

w — 1) of the polynomial Pn-i (^)- 

2®. Applying Horner’s scheme to the polynomials 
Pn-i {x), Pn-2 • • •» ^n-/i calculate the coef- 
ficients An^k = ^n-h (^’*) coeffic ion Is 

(i = 0, 1, . . n — k — 1) of the polynomial 
Pn-h-\ process is completed when k becomes 

equal to ri — 1. Then we set ~ 

We have thus found all the coefficients Aj. 

This algorithm is often called the generalized Horner’s 
scheme. 

Example 3. In the polynomial (j) = i2x^ + 4 pass 

to a new variable y — j: + 2 . 

A Using relations (5) and (G), we compose a table: 


12 

19 

-24 

0 

10 

0 

-20 

-4 

40 

12 

-5 

10 

-20 1 

36 - /I4 


-24 

58 

-13f) 


12 

-29 

G8 

-156 

= /1 3 

' 

-24 

106 



12 

-53 

174 




-24 




12 

-77 

= ^i 




12 =Ao 

Thus the polynomial <^4 {y) ^ P^ {y - 2) has th(3 form 
<?4 iy) = 12 / - 77/ [- 174.v2 - + 3G. £ 

4.2. Calculating the Values of Analytic Functions 

The calculation of the values of an analytic function 
is often based on representing it as a quickly converging 
Taylor’s series which is in many cases a convenient in- 
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stniment for calculating the values of this function at 
the points belonging to the domain of convergence of the 
series. 

Assume that we have to find the value of the function 
/ {x) analytic on the interval [a, h] at the point x = x*, 
X* 6 [fli with a specified limiting absolute error e. 

Taylor’s formula with the remainder in Lagrange’s 
form for the function / (x) in the neighbourhood of the 
point X = c, c ^ [a, b] has the form 


-I- . . . +(a; — c)" 


nl 


1^ 


(c) 

in 1 - 1 )! 


where c ^ c -\- 0 (x — c), 0 < 0 <; 1 . 

Conseqiuuitly, the problem of computing / (x*) reduces 
to the calcuiatiou of 


/ (x*) = (x*) + Jin (^*), 

where (.;■*) is the /?th partial sum of the series: 

(()!- 1, /(«)(c) ./(c)), 

and Rj^(x*) is the value of the reTe.ainder ( ) for 
X - - .r*: 

c* ^ c H- 0* (.r* — c), 0 < 0* < 1 . 

The algorithm of the solid ion of this problem is the 
following. 

1°. On the interval [a, bl we choose a point x — c as 
close to the point x — x* as possible and such that the 
function / (x) itself and ils derivatives can be easily 
calculated for x = c. 

2®. We represent e as the sum 


E — El Co + Eg, 


(1) 
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where is the residual error (the error of the method), 
Eg is the limiting absolute error of calculation of 
63 is the limiting absolute error of rounding off of the 
result. Generally speaking, eg and 63 can be arbitrary 
positive numbers satisfying condition ( 1 ). 

In practial calculations e is usually given in the form 
e = 10“’”, where m is an integer. Then we usually assume 
that 83 = 0.5-10“’” and 61 = 82 = 0.25-10“’”. If there 
is 00 error of the final rounding-off, then we assume that 
Fj = Fg = 0.5-10"’”, 83 = 0. 

3®. Wo choose the number of terms in Sn such that 
the inequality 

is satisfied. 

4®. Each term in is calculated so that the approxim- 
ate value of Sn differs from the exact value o^f by not 
more than Eg. For that purpose, each term of 5^ is usually 
calculated with an absolute error 82/(72 -f 1 ). 

5®. The approximate sum S^. obtained in 4® is rounded 

off (if 83 0 ) to the value 

()®. The solution of the problem is written in the form 

/ u*) ± 8. 


Example. Calculate with an accuracy to within 8 = 0.01. 
A Taylor’s formula with the remainder in liagrange’s form for 
the function e^ in the neighbourhood of the point x = 0 has the 
form 


e*=l + 


X 

IT 


I I I I Bx 




o<0< 1 . 


Since for large x Taylor’s series of the function g* converges 
slower, it is expedient to calculate the value of as the product 

p2.j,0.26 

The quantity e^ can bo easily calculated with any degree of 
accuracy and we can assume that practically the error of its cal- 
culation is zero. 

Let us assume that the errors of rounding off and oalculation of 
e2.^o.25 are equal to 0.005. Then the error of calculation of e®-*® 
is e = 0.005/e* s 0.0006. 

Thur^ we have reduced the calculation of e*-** with an accuracy 
of e = 0.01 to the calculation of 


00 . 26 =, 1 + 0 . 25 * 



with an accuracy of e = 0.0006. 


0.25’^ 

n! 


^eO.250 


0 . 25 ’**^ 
(n + l)I 
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Assume, furthermore, that ei =» = 0.0003. We shall find n 

using the remainder of Taylor’s formula for e* when x = 0.25: 


e0.259, 0;25"**- <0.0003; O<0<1. 

( 11 + 1)1 

Taking into account that e®-*®® < e®*®^ < 1.5, we get n > 3. 
Consequently, we must calculate the sum 


53 = 1 + 0.254 


0.252 

21 


0.25® 

31 


with an absolute error 0.0003. Since we have calculated the first 
two terms with an absolute accuracy, it is sufficient to calculate the 
second and the third term with the limiting absolute error of 
0.0001 each. Performing the necessary calculations, we find that 

^3 = 1 + 0.25 + 0.0312 + 0.0026 = 1.2838. 

Multiplying the result by e®, we get 62^3 = 9.4860... . Finally, 
rounding off to the hundreds place, we get e*-*® = 9.49 ± 0.01. 


We can F^milarly calculate the values of trigonometric 
functions (sine and cosine). The corresponding Taylor’s 
formulas with the remainder in Lagrange’s form are 

smx = x-^+-^ 




-2n-i 


(2n-l)l 


cos x = I — 


(- 1 )" 


**ntl 

(2n+l)l 


0, o<e<i, 


( 2 ) 


21 


^ 41 






-sn 


(2re— 2)1 




The argument in formulas (2) and (3) must be in radians 
and belong to the interval [0, n/4]. In that case the con- 
vergence of the corresponding series will be sufficiently 
fast. The reduction formulas and the known relation of 
trigonometric functions will make the argument belong 
to the indicated interval. 

Thus, for instance, to calculate the value of sin 2.53, 
we must use the reduction formula sin 2.53 = 
sin (ji — 2.53); the argument ji — 2.53 belongs to the 
interval [0, ji/4]. To calculate the value of cos 1.27, we 
must use the formula cos 1.27 = sir. (ji/2 — 1.27) and 
compute the value of the sine since (n/2 — 1.27) 6 
(0, ji/41. 
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We write the condition for the choice of the number of 
terms n in calculating the value of the sine as 

«2n+i 

(2n+i)i 

and in the calculation of the cosine as 

r2n 

xg[0, n/4]. (5) 

Ihe formula for the expansion into series 


ln(l + :c) 


is hardly convenient for calculating the values of a log- 
arithmic function because of the slow convergence for 
\x 1 close. to unity. In addition, this formula does not 
allow us to calculate the logarithms of numbers larger 
than two. 

To accelerate the convergence and expand the domain 
of applicability, we transform formula (6) as follows. 
Replacing x by —x on its right-hand and left-hand sides, 
we have 


In (1 .t) — — X 


T 




Subtracting the initial relation from the resulting one 
we find that 


In 


i — x 
i + x 


= -2{» + t + X+---+S^ 



Setting now (1 — x)/(l + x) = z and bearing in mind 
that X = (1 — z)/(l + z), we obtain the initial formula 
for calculating the natural logarithm of any number z 
belonging to the interval (0, oo): 


‘-"-2[TS+x(jf-;r+4(4^7r+-]- 


( 7 ) 


In practical computations, it is convenient to repre- 
sent the positive number a:, whose natural logarithm must 
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bo found, in the form 


X = 

where m is an integer and 

0.5 <z< 1. 


Then 


(8) 

( 0 ) 


In X = m In 2 -|- Jn z. 

It is easy to calculate the lirst term for the known m and 
In 2 = 0.09214718 . . and the second term can be 
found from fonnula (7). By virtue of inequality (9), the 
quantity 

l = - z)/(1 + z) (10) 

varies in the limits 

0 < K 1/3, (11) 


and this ensures fast convergence of series (7). 

The final result is 

ln,x. mIn2-2 (g+|. + |-+ . . . (12) 
We estimate the remainder: 


R „-2 


^2n+i g2n+3 


2/1 -f- 1 2/1 + 3 




2/1 + 1 


^2n+i 

1-1“ 


Using inequality (11), we can reduce this estimate to 
the form convenient for comparison with the correspond- 
ing terms of series (7): 



^2Tl+l 

2n-|-l ^ 4(2re-hl)’ 


( 13 ) 


To compute the value of a decimal logarithm, we must 
use the formula 


log X = 71/ In Xy 

where M = log e = 0.434294481903252 , . .. 
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4.3. The Iterative Method of Calculating tlie Value 
of a Function 


Consider one more artihcial technique of calculating 
the value of the function 

y = i (x), ( 1 ) 

continuous on the interval [a, &], at the point x = 

X* z tl- 

Ihis technique is based on the use of Newton’s method 
for solving algebraic and transcendental equations and 
consists in the following. 

1°. Function (1) is written in implicit form and the 
value of X* is substituted for x in the resulting expres- 
sion: 

F (X*, y) = 0. (2) 

The required value of the function y* = f (a;*) is precisely 
the solution of this equation. 

2®. Equation (2) is solved by Newton’s method, for 
which purpose the initial approximation yo is chosen such 
that the condition 

yo)>0 (3) 

is satisfied and each successive approximation (« = 
1, 2, 3, . .*.) is calculated from the formula 


Vn = Vn-i ■ 


yn-i) 
^ ’y (**» !/n-l) 


(n=l, 2, 3, ...). 


(4) 


The convergence of the iterative process (4) is ensured 
when the function F (x*, y) satisfies the conditions of 
convergence of Newton’s method. 

Note that there are numerous ways to represent Junc- 
tion (1) in implicit form (2), from which we must choose 
the representation such that the iterative process (4) 
would be convergent and the rate of convergence would 
be sufficiently high. 

An important example of this technique is the calcu- 
lation of the function y = x {m = 2, 3, . . .) in the 
interval (0, oo). 

It is expedient to use the expression “y"* — x as 
^ (^*> y) for this function. Then condition (3) is reduced 
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to the form 


yo>V^* 


and the iterative process (4) to the form 


!/n 




mijTiil 


(3') 

(4') 


Nolo that by virtue of the properties of tln^ fiiiictiou 
yin — iterative process (4') converges not only 

when condition (3') is fulfilled but also for any positive 
initial approximation >> 0. In this case the condition 
yri > 1 7 • •) will he fnlliiled for all the 

successive approximations. 

We can estimate the (‘rror of tln^ approximation y^ 
as follows: 


A?/ Un —7 3:*< 


' yn) y 


or 


A//„ 


yn — 7 


ni — 1 


j.m-i 


.Vn-l— //n) 




Since I lie case of rn ^ 2 is encountered much more 
rrot[uently, we shall give for it a more accurate estimate 
of the error. 

We represent .i* in the form .z* == whe-e k is 

an integer .t* g [0.3, 1). Tlien, setting , we 

obtain 


A//„ 


yn 


— l/.c 


.25 




^ 2r. 



Example. Calculate ( 34 with an accuracy of e ™ 10“^. 

A In accordance with inequality (3') we choose = 3.4 >- 
y' 34. Then, using formula (4') for x* = 34 and =- 3.4, wo find, 
in succession, y^^ and calculate Ay„ from formula (5): 

i/,-3.4- 3.247. !/i-0.oi; 

y., --- 3.247 = 3.23964, Ay. - 2- Id"®. 


Thus i 34 --3.23'.H)4± 0.00002. 4 
12-0104 



Computational Mathematica 


l^S 

Exercises 

1. Using Horner’s scheme, perform the division of the poly- 
nomial P 5 (x) = X® + 3x^ — 2x® — X + 1 by the binomial x — 3. 

2. Find out whether g = 1 is a root of the equation x® 2x® — 
3 = 0. 

3. Use the expansion in a power series with an accuracy of 
e = 0.001 to calculate (a) sin 25°, (b) cos 20°, (c) In 4, (d) 

(e) cos 3G°, (f) sin 18°. 

4. Use the iterative method to calculate, with an accuracy of 
e = 0.0005, (a) Vi2, (b) VM, (c) /42. 



Chapter 5 


Methods of Solving 
Nonlinear Equations 


5.1. Algebraic and Transcendental Equations 

In practical problems we often have to solve equations. 
We can represent every equation in one unknown in the 
form 

<r M = /?■ (^), (1) 

where (p (x) and g (x) are given functions defined on a 
number r.ul X called the domain of permissible values of 
the equation. 

We can write an equation in one unknown as 

/ ix) = 0. (2) 

Indeed, transferring g (x) to the left-hand side of equation 
(1), we get an equation cp (x) — g (x) = 0 which is equiv- 
alent to (1). If we designate the left-hand side of the last 
equation as / (x), wo get equation (2). 

The set of values of the variable x for which equation 
(1) turns into an identity is a solution of this equation 
and every value of x from that set is a root of the equation. 

For instance, the equation x'^ = 2 — x has roots x^ = 
— 2 and x^ — Substituting — 2 and 1 into the given 
equation for x, we get identities (—2)- = 2 — (—2), 
i.e. 4 = 4; 1- = 2 — 1, i.e. 1=1. 

To solve an equation is to find the set of all roots of 
the equation. It may be finite or infinite. Thus the equa- 
tion considered above has two roots. The equation sin x = 
0 has a solution x = nn (n = 0, ±1, zh2, . . .). Assign- 
ing different values to n, we got an infinity of roots. 

A set of several equations in several unknowns is a 
system of equations (the unknown denoted by the same 
letter in all the equations must mean the same unknown 
quantity). 


12 * 
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A solution of a system of equations in several unknowns 
is the set of values of the unknowns which turns every 
equation of the system into an identity. 

For example, the system 


r x2-|-!/ = 5, 

I a: |-i/2 = 3 

has a solution x — 2, y = 1 since for these values of the 
unknowns the equations of the system turn into identities: 
4 1 =5^ 2 + 1 = 3. 

To solve a system of equations is to find the set of all 
its solutions or to show that it has no solutions. 

According as what functions enter into equations (1) 
and (2) equations are divided into two largo classes, 
algebraic and transcendental equations. 

A function is algebraic if, in order to got tlio values of 
the function proceeding from the given value of x, we 
must perforin arithmetic operations and raise to a power 
with a rational exponent. (The operation of extracting 
a root can be represented as the operation of raising to 
a power with the exponent 1/n.) 

An algebraic function is rational with respect to the 
variable x if no operations except for addition, subtrac- 
tion, multiplication, division and raising to an integral 
power are performed which involve x. 

For example, 

/,(a:) = a:* + 15a:2 — 1200a: + 4, /a (a:) = i 


/3(a:)^(x-4)(x + 5), . 

If the variable x does not enter into a rational function 
as a divisor or does not enter into the expression which 
is a divisor, then the rational function is an integral, 
or entire, rational function. 

For instance, the functions 

y = a^x'^ + aiX'^'^ an (A^ is a natural number 

or zero, flo» • • •» real numbers with ao ^ 0), 


f{x) 


T 


X -j- 8 

■~3“ 


are entire rational functions. An entire rational function 
is defined throughout the number axis. 
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If, in a rational function, a division by the variable x 
is encountered at least once or the variable x enters into 
the expression which is a divisor, then the function is a 
rational fractional function. 

For instance, the function 

where m is a natural number or zero, n is a natural num- 
ber, ao, • • • ^re any real numbers {a^ ^ 0, 

Uq ^ 0), is a rational fractional function. 

A rational fractional function is defined on the entire 
number axis except for the points at which the denomi- 
nator vanishes. 

A function is Irrational if, to obtain the value of the 
function proceeding from the given value of x, we must 
perforin, lu -uldition to the four arithmetic operations 
(all or some of them), the operation of extracting a root. 
In that case, the function is irrational only if the argu- 
ment X is under the sign of the radical. 

Thus the function 

3x2— 4x+ V x — i 
y - — 7531 — 

is irrational whereas the function 



is not irrational since x is not under the sign of the rad- 
ical. 

We have mentioned earlier that all rational and irra- 
tional functions belong to the class of algebaric func- 
tions. 

Transcendental functions is another large class of 
functions. They include all nonalgebraic functions, i.e. 
an exponential function a*, a logarithmic function loga x, 
trigonometric functions sin a:, cos a:, tan 2 :, cot x^ in- 
verse trigonometric functions arcsin x, arccos x^ arctan r, 
arccot X and others. 

If the notation of an equation includes only algebraic 
functions^ then the equation is algebraic. 
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For instance, the equations 

a:* — 4 = 0, — 3x^ + 5x^ — x + I =0 

are algebraic. 

An algebraic equation can be reduced to the form 

a^x^ + + ^2 + . . . + a^^^x + = 0- (3) 

Therefore, when we say “an algebraic equation”, we usually 
have in mind an equation of form (3). 

If equation (3) has been obtained by means of the 
transformation of an equation which contained a rational 
fractional or irrational function, then we must take into 
account the fact that these functions are defined not 
throughout the number axis. 

For instance, the equation 

Yir^+Y^x=3 

assumes the form 


Ax^ — IGx — 47 = 0 


after the function is rationalized. However, the initial 
equation is defined not on the entire number axis but only 
for X which belong to the interval [2, 61. 

The numbers Uq, a^, . . ., a„ are the coefficients of 
equation (3)' and may be real as well as complex. In what 
follows, we consider algebraic equations of form (3) only 
with real coefficients. 

To solve an equation in one unknown is to find its roots, 
i.e. the values of x which turn the equation into an iden- 
tity. The roots of an equation may be real or nonreal 
(complex). 

We can find the exact roots of an equation only in 
exceptional cases, usually when there is a simple formula 
for the calculation of the values of the roots which makes 
it possible to express them in terms of the known quan- 
tities. 

Thus, to find the roots of a quadratic equation of the 
form x^ px q = 0, we use the formula 



( 4 ) 
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To solve a cubic equation of the form + 1>X + g = 0, 
wo use the formula 

+ "T+lr- ® 

However, it is diflicult to use this formula in practice 
since it requires the use of complex numbers. 

There is also a formula for solving a fourth-degree 
equation but it is so complicated that it is not employed 
in practice and we shall not consider it here. 

Abel, a Norwegian mathematician, has proved that for 
n ^ 5 there is no formula which would express the solu- 
tion of ^b.j .Ijebraic equation (3) by means of the arithmet- 
ic operations and the extraction of roots. Only in some 
special cases there may be formulas for solving algebraic 
equations whose degree is higher than four. 

In addition, the coefficients of some equations are 
approximate numbers and, consequently, we cannot pose 
the problem of finding exact roots. 

Therefore, of considerable importance are the methods 
of approximation of the roots of the equation / (x) = 0. 

In many practical problems it is not always necessary 
to lind the exact solution of an equation. The problem of 
linding the roots is considered to be solved when the roots 
are calculated with the specified degree of accuracy. 

Then how must we understand the statement “the root 
has been calculated with the specihed degree of accur- 
acy”? Let g be a root of an equation and x its approximate 
value with an accuracy of e. This means that 1 fe — x ] ^ 
e. If it is established that the required root ^ is between 
the numbers a and h, i.e. a < S with h — a ^ e, 

then the numbers a and b are approximate values of the 
root by excess and by defect respectively, with an 
accuracy of e since — a \ < b — and | ^ — b \ 

a b — a We can assume any number included 

between a and b to bo an approximate value of the root | 
with an accuracy of e. 
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For instance, if the root g is between 3.228 and 3.229 
(i.e. 3.228 < i < 3.229), then, with an accuracy of 
0.001, we can take the number 3.228, 3.229 and any 
number included between them to be an approximate 
value of the root. 

In this chapter we consider the methods of approxi- 
mation of equations and systems of equations. Some of 
them can be employed in the solution of both transcen- 
dental and algebraic equations. Other methods can bo 
used to solve only algebraic equations. 

5.2. Separation of Roots 

The process of seeking approximate values of the roots 
of an equation can he divided into two stages: (1) scpara 
tion of the roots, and (2) computation of the values of the 
roots with the specified degree of accuracy. 

This section is devoted to the first stage, i.e. separation 
of roots. 

The root | of the equation / (x) =0 is considered to bo 
separated on the interval [a, i] if the equation j {x) = 0 
has no other roots on this interval. 

To separate roots is to divide the whole domain of 
permissible values into intervals in each of which there 
is one root. There are two methods of separating roots, 
graphical and analytical. 

Graphical method of separating roofs. \st tecluiique. 
It is easy to separate roots if the graph of the function 
y = f (x) is constructed. The points of intersection of the 
graph and the x-axis yield the values of the root and it is 
easy, using the graph, to find two numbers a and h which 
include only one root between them (Fig. 5.1). 

2nd technique. All terms of an equation are divided into 
two groups, one of them is written on the left-hand side 
of the equation and the other on the right-hand side, i.e. 
the equation is represented as cp {x) = g {x). Then the 
graphs of two functions, J/ = 9 (a:) and y = g {x), are 
constructed. The abscissas of the points of intersection 
of the graphs of these two functions are the roots of the 
equation. Let the point of intersection of the graphs have 
abscissa Xq and the ordinates of the two graphs at that 
points be equal, i.e. q) (xJ = g (x^). It follows from 
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this equality that is a root of the equation (Fig. 5.2). 
The numbers a and h which include the root between them 
can be determined from the graph. 

Example 1. Use graphical means to find the integers between 
which the roots of the equation — 3a: — 1 = 0 are included. 

A Ut technique. We construct the graph of the function y = 

— 3a: — 1 (Fig. 5.3) and find the abscissas of the points of inter- 
section of the graph and the a:-axis. The curve cuts the x-axis at 



three points, 'and, consequently, the equation has three real roots 
(note that a third-degree algebraic equation has either one or three 
real roots). We can see from the drawing that the roots belong to 
the intervals [—2, ^1), [—1, 0] and [1, 2). 

2nd technique. We represent the equation in the form ~ 3x i 
and construct the graphs of the functions x = and y = 3x + 1 
(Fig. 5.4). The abscissas of the points of intersection of the graphs 
of these functions are roots of the equation. The intervals of the 
separation of the roots can be easily found from the drawings. 4 

Example 2. Use graphical means to separate the roots of the 
equation log x — 3x + 5 = 0. 

A We rewrite the equation as follows: log x - 3x — 5. The 
functions on the left-hand and right-hand sides of the equation 
have a common domain of definition, the interval 0 < x < +oo. 
We shall therefore seek the roots in this interval. 

We construct the graphs of the functions y = log x and y = 
3x — 5 (Pig. 5.5). The straight line y = 3x — 5 cuts the logarithmic 
curve at two points. It is difficult to show on the drawing the inter- 
section of the graphs of these functions at the first point. However, 
taking into consideration that the lower branch of the logarithmic 
curve approaches the y-axis indefinitely, we can assume that the 
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intersection of the graphs will be close to the point of intersection 
of the graph of the function y = Zx — 5 and the y-axis. Thus the 
roots lie on the intervals [0, 0.5] and [1, 2], ^ 

Example 3. Use graphical means to separate the roots of the 
equation x — cos x = 0. 

A We rewrite the equation in the form x = cos x and construct 
the graphs of the functions y = x and y = cos x in the interval 
— 3rc/2 < a; ^ ji/2. The graphs of the functions intersect at one 
point; in this interval the equation has one root. Taking into account 




the properties of the functions y = x and y = cos x, we C8i.n make 
sure that outside of this interval the equation has no roots. If we 
construct a more precise drawing, we can find that the root is on the 
interval [0.6, 0.8] (Fig. 5.6). ^ 

Example 4. Use graphical moans to separate the roots of the 
equation 2* — 5 j: — 3 = 0 employing two techniques. 

A Isi technique. We construct the graph of the function y = 
2* — 52; — 3 and determine the abscissas of the points of inter- 
section of the graph and the 2 ;-axis. The curve cuts the 2 :-axis at 
two points, and, consequently, the oauation has two real roots. 
It can be seen from the drawing that tne roots lie on the intervals 
[-1, 0] and [4, 5] (Fig. 5.7). 

2nd technique. Wo represent the equation in the form 2-^ = 
fix + 3 and construct the graphs of the functions y = 2* and y = 
5x + 3. We find the abscissas of the points of intersection of the 
. ' I of these functions which arc the roots of the given equation. 
We get the same intervals of separation of the roots (—1, 0] and 
(4. 5J (Fig. 5.8). A! 
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Remark. Assume that the graph of the function y = 
/ (x) has the form given in Fig. 5.9. The curve cuts the 
abscissa axis three times and, consequently, the equation 
has three simple roots. 

Now if the curve touches the abscissa axis (Fig. 5.10), 
then the equation has a root of multiplicity two. For 



Fig. 5.9 Fig. 5.10 


instance, the equation — 3;r -1- 2 = 0 has three roots, 
Xj = —2, X2 = Xs = i (Fig. 5.11). 

If an equation has a real root of multiplicity three, 
then, at the point where the curve y = f (x) touches the 



Fig. 5.11 Fig. 5.12 


axis, it has a point of inflection (Fig. 5.12). For instance, 
the equation x^ — Sx^ -\- 3x — 1 =0 has a root of 
multiplicity three equal to unity (Fig. 5.13). 

The graphical method of separation of roots is not 
very precise. It makes it possible to roughly determine 
the intervals of separation of the roots. Then one of the 
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techniques given below is used to compute the values of 
the roots. 

Analytical method of separating roots. We can separate 
the roots of the equation f (x) = 0 analytically if we 
use some properties of functions studied in the course 
of mathematical atialysis. 

We shall formulate, without proof, some theorems 
which must be known in order to si^parah' roots. 



Fig. 5.13 


Theorem 1. If the function f (x) is continuous on the 
interval [a, b] and assumes values of unlike signs at r e end- 
points of this interval, then at least one root of the ei^uation 
f {x) = 0 lies within this interval. 

Theorem 2. If the function f (a:) is continuous and mono- 
tonic on the interval [a, ft] and assumes values of unlike signs 
at the endpoints of this interval, then there is a root of the 
equation f {x) = 0 within the interval [a, h] and that root 
is unique. 

Theorem 3. If the function f (x) is continuous on the 
interval [a, ft] and assumes values of unlike signs at the 
endpoints of this interval and the derivative /' {x) retains 
sign within the interval, then there is a root of the equat^i^n 
f {x) = 0 within the interval and thu root is unique. 

Here are some data from mathematical analysis which 
will be needed later on. 



190 


Computational Mathematics 


If the function / (a;) is defined analytically, then the 
domain of existence {domain of definition) of the function 
is the set of all the real values of the argument for wluQh 
the analytical expression defining the function does not 
loose the numerical sense and assumes only real values. 

Tlie funclion y = f (x) is monotonic in a given interval 
if it satislies the condition / (oTg) ^ / (^i) the condition 
/ (X 2 ) ^ for any X 2 > belonging to this interval. 

If the continuous function y = f (x) has a derivative 
at all interior points of the given interval, then the neces- 
sary and sufficient condition for the monotonicity of the 
function in this interval is the satisfaction of the inequal- 
ity f (x) ^ 0 or /' (x) ^ 0. 

Let the function / (x) be continuoqs on the interval 
la, /;! and assume values of unlike signs at the endpoints 
of that interval and let the derivative /' (.r) retain sign 
in the interval (a, 6). Then, if at all points of the interval 
(a, b) the first derivative is positive^ i,e, f {x) > 0, then 
the function f (x) increases in this interval (Fig. 5.14 a, c). 

Now if the first derivative is negative at all points of the 
interval (a, 6), i,e. f (x) < 0, then the function decreases 
in this interval (Fig. 5.14 fe, d). The root of the function 
is the abscissa of the point of intersection of the graph 
of the function / (j:) and the x-axis. 

Assume that on the interval [a, b] the function / (:r) has 
a second-order derivative which retains sign throughout 
the interval. Then, if f (x) > 0, then the graph of the 
function is convex downwards (Fig. 5.14 a, d); now if 
f (x) < 0, then the graph of the function is convex upwards 
(Fig. 5.14 6, c). 

The points at which the first derivative of the function 
is zero and also the points at which it does not exist (say, 
vanishes), but the function retains its continuity are 
critical points (this test is the necessary condition for 
extremum). 

If the function / (x) is continuous on the interval [a, 61 
then there are always points on this interval at which 
it assumes its greatest and least values. The function 
attains these values either at the critical points or at 
the endpoints of the interval. Consequently, to find the 
greatest and the least value of the function on a closed 
interval, we must (1) find the critical points of the func- 
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tion, (2) calculate the values of the function at the critical 
points and at the endpoints of the interval [a, i>l, (3) the 
greatest value found in item 2 will be the greatest and the 
least value will be the least value of the fiinrtion on the 



r(x)>o, r{x)>^ fix) < 0 , rix)<o 



Fig. 5.14 


closed interval. In accordance with the aforesaid, we can 
recommend the following sequence of operations to separ- 
ate the roots using the analytical method. 

(1) find the first derivative f (x), 

(2) compile a table of signs of the function / (x) setting 
X equal to: (a) the critical values (roots) of the derivative 
or the values close to them, (b) the boundary values 
(proceeding from the domain of permissible values of the 
unknown), 
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(3) determine the intervals at the endpoints of which 
the function assumes values of opposite signs. These in 
ter\ als contain one and only one root each in its interior. 

Example 5. Separate the roots of the equation 2* — 5a: — 3 = 0 
using the analytical method. 

A We designate / (x) = 2^ — 5x — 3. The domain of definition 
of the function / (a:) is the entire number axis. We seek the first 
derivative f' (x) — 2^ In 2 — .5. 

We equate this derivative to zero and calculate the root: 

2^ In 2 -5 =0, 2^ In 2 - 5, 2^--5/ln2, 

X log 2 log 5 — log In 2, 

log5-logln2 0.6990 + O.1592 0.8582 ^ 

log2" ■ (l.3''10 ■’ ().3')1() ~ ■ ■■ 

We compile a table of signs of the function / (a:) setting x equal 
to: (a) the critical values (the roots of the derivative) or the 
values close to them, (b) boundary values (proceeding from the 
domain of permissible values of the unknown): 


X 

1 — CX) 

2 

3 

-|-oo 

Sign of / (a:) 

-f 

— 

— 

+ 


The equation has two roots since the function twice changes sign. 
We compile a new table with smaller intervals of the separation 
of the root: 


z 1 

0 

1 

1 ^ 

3 

4 

5 

Sign of / (i) + 

— 

— 

— 

— 

— 

-1- 


The roots of the equation arc in the intervals ( -1, 0) and 
(4, 5). A 

5.3. GoinpuUiig Roots with a Specified Accuracy. 

Trial and Error Method 

The preceding section was devoted to the separation of 
roots, the first stage of solution of algebraic and trans- 
cendental equations. 

The second stage is the computation of roots with the 
specified degree of accuracy. 

We consider here some ways of relining roots used to 
solve algebraic and transcendental equations. There arc 
techniques, however, which can only be employed to solve 
algebraic equations. We shall consider them later on. 
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Consider an equation / (.x) ~ 0, where / (x:) is a con- 
tinuous function, Wc have to lind the root g of the equa- 
tion with an accuracy of 6, where e is some positive suflic- 
iently small number. 

We assume that the root | has been separated and Jies 
on the interval [a, 6], i.e. there holds an inequality 
a ^ g ^ h. The numbers a and h are approximate values 
ol‘ the root | by defect and by excess respectively. The 



error of these approximations does not exceed the length 
of the interval h — a. If 6 — a ^ 6, then the necessary 
accuracy of calculations is attained and we can take either 
a ov b AS the approximate value of Now if ^ — a > e, 
then the required accuracy of calculations is not attained 
and the interval containing ^ must be made narrower, 
i.e. the numbers a and h must be chosen so that the in- 
equalities a a ^ b and b — a <i h — a are satisfied. 
Tlie calculations must be terminated when b — a ^ e 
and either a ot b must be taken as the approximate value 
of the root with an accuracy of e. It should be pointed 
out that the value of the root will be more exact when we 
take the midpoint of the interval, i.e. c = (a + b)/2, 
rather than the endpoints a and b, as the approximate 
value of the root. In this case the error does not exceed 
the value {b — a)/2. 

Assume that the root g of the equation f (x) = 0 If {x) is 
a continuous function] has been separated on the interval 
[a, 6], i.e. / (a)*/ (b) C, 0, with b — a> e. We have to 
find the value of the root \ with an accuracy of e (Fig. 5.15) 


13-0104 
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On the interval [a, 6 ] we arbitrarily choose a point 
which bisects it into two intervals la, Ui] and lai, fc]. 
Out of these two intervals wo must choose the interval 
at whose endpoints the function assumes values opposite 
in sign. In the case being considered f {a) -J (uj) > 0, 
f •/ (ft) < 0 i we must therefore choose the interval 
lui, b\. Then, on this narrowed interval, we again arbit- 
rarily choose a point ag and find the signs of the products 



/ («i) */ (^ 2 ) and / (fla) 7 (ft)- Since / {a^) 7 (ft) < 0, we 
choose the interval b]. We continue this process until 
the length of the interval on which the root lies becomes 
smaller than e. We obtain the root g as the arithmetic 
mean of t&e endpoints of the interval obtained; the 
error of the root does not exceed e/ 2 . 

The method we have considered is known as the trial 
and error method. 

In the form considered above this method is not applic- 
able to calculations on computers. To compose a program 
and to make calculations on computers, it is used in the 
form of the so-called bisection method. 

Assume that the root g of the equation J (x) 0 has 

been separated and lies on the interval [a, 6 ], i.e. / (a)* 
/ (b) < 0 , with b — a> e [here / (x) is a continuous 
function]. As before, we take an intermediate point on 
the int' rval [a, b], not in an arbitrary way, however, 
but so that it is the midpoint of the interval [a, 6 ], i.e. 
c = {a b)/2. Then the point c divides the interval [a, b] 
into two equ*al intervals [a, cl and [c, b] which are equal 
in length to {b — a)/2 (Fig. 5.16). If / (c) = 0, then c 
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is the exact root of the equation / (x) = 0. Now if / (c) = 5 ^ 
0 , then out of the two intervals [a, c] and [c, b] obtained 
we choose the interval at whose endpoints the function 
/ {x) assumes values opposite in sign. We designate this 
interval as Then we again bisect the interval 

[cLi, b^] and present the same arguments. We get an 
interval ^^ 2 ^ whose length is {b — 0)12^, We continue 
the process of bisection until, at some nth stage, either 
the midpoint of the interval proves to be a root of the 
equation (a case seldom encountered in practice) or we 
get an interval [a^, ^^^l such that b^ — an = {b — a)/ 2 ” ^ 
8 and an ^ e ^ bn (the number n indicates how many 
divisions have been performed). The numbers an and bn 
are roots of the equation / (a;) = 0 with an accuracy of e. 
As was indicated above, we must take ^ = (a„ + bn)l2 
as the approximate value of the root. In this case the 
error dofw exceed {b — 

Example t. Use the trial and error method to make the smaller 
root of the equation + 'Sx^ — 3 = 0 accurate to 8 = 10"®. 

A We use the analytical method to separate the roots of the 
equation. The function / (x) is defined throughout the number axis. 
Equating /' (x) to zero, we calculate the root of the derivative: 

/' (x) = 3x2 -h 6x, 3x2 6x = 0, X (x + 2) = 0, xj = 0, Xj = --2. 

We compile a table of signs of the function: 

X I —CX) I —2 I —1 I 0 I 1 I -\-oo 


Sign of /(:t) I - 1 + I _ 1 _ 1 + I + 

Wf‘ see that the first root lies in the i/ilerval (— 00 , —2). We 
try the root x — — 3 and find that / (~3) = — 3: 


X 

-3 

-2 

-1 

0 

1 

Sign of / (x) 

— 

+ 

— 

— 

+ 


This means that the roots of the equation + 3x2 — 3 = 0 
lie in the intervals (—3, — 2), ( — 2, — 1), (0, 1). 

We refine the smaller root, which lies in the interval ( — 3, — 
using the bisection method. For the sake Oi. onvenience, we com- 
pile a table (see Table 5.1). The signs — and + in the upper indices 
of an and bn mean that / («„) < 0 and / {bn) > 0. 

Thus the root of the equation x ^ — 2.532. ^ 


13 * 
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Table 5,1 


n 



_ “n+'’n 

2 

n 

3x2 

/(*„) 

0 

-3 

-2 

-2.500 

1 

-15.625 

1 

18.750 

0.125 

1 

-3 

-2.500 

-2.750 

-20.800 

22.689 

-1.111 

2 

-2.750 

-2.500 

-2.625 

-17.990 

20.670 

-0.320 

3 

-2.625 

-2.500 

-2.563 

-16.840 

19.701 

-0.139 

4 

-2.563 

-2.500 

-2.532 

-16.230 

19.233 

0.003 

5 

-2.563 

-2.532 

-2.548 

-16.540 

19.479 

-0.071 

6 

-2.548 

-2.532 

-2.540 

-16.390 

19.356 

- 0.034 

7 

-2.540 

-2.532 

-2.536 

-16.310 

19.293 

-0.014 

8 

-2.536 

-2.532 

-2.534 

-16.270 

19.263 

-0.007 

9 

10 

-2.534 

-2.533 

-2.532 

-2.532 

-2.533 

-16.250 

19.248 

-0.002 


Example 2, Use graphical means to separate the root of the 
equation logo . 6 (« + 1) = Calculate tne root by the method 
of trial and error with an accuracy of e = 10 "^. 

A We represent the equation in the form logo . 5 (ar + 1) = 1/a:* 
and construct the graphs of the functions y = logo . 5 (^ + ^) 



and y = 1/a:*. We see from Fig. 5.17 that the equation has one root 
Xi “ —0.7. We determine the signs of the function on the left and 
on the right of xi. 


X 

-0.8 -0.5 

Sign of / (x) 

+ - 
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To make the calculations more convenient, we pass to the decimal 
logarithms: 


/ (x) = 


log (J + I) 
log 0.5 


1 — 


log (3^+1) 

— 0.301 


1 . 


Wo compile the following table (Table 5.2): 


Table 5.2 


n 

n+ 

n 

On 

"n+^n 

.r2 

n 

log (r^-lt) 

t(Xn) 

2 

0 

-0.8 

-0.5 

-0.65 

0.4225 

-0 .4559 

-0.360 

1 

-0.8 

-0.65 

-0.73 

1 0.5329 

-0.5686 

-0.0067 

2 

-0.73 

-0.65 

-0.69 

0.4761 

-0.5086 

-0.196 

3 

-0.73 

-0.69 

-0.71 

0.5041 

-0.5376 

-0.099 

4 

-0.73 

-0.71 

-0.72 

0.5184 

-0.5528 

-0.048 

5 

-0 73 

-0.72 






Thus Xi ^ —0.73. 


5.4. Method of Chords 

Tilt? method of chords is one of the most widely used 
methods of solving algebraic and transcendental equa- 
tions. In literature it is also encountered under the names 
of “the method of false position” (rogula falsi method) and 
“the nietliod of linear interpolation”. 

Consider an equation / {x) = 0, where / (x) is a con- 
tinuous function Avhich has derivatives of the first and 
the second order in the interval (a, b). The root is assumed 
to be separated and is on the interval [a, b], i.e. / (a) • 

The idea ol this method is that on a suflicieutly small 
interval fr/, h] the arc of I he curve // - / (a) is replaced 
by the chord subUmdiiig it. 'The point of inlersection of 
tlie chord and the x-i\x\s is taken as the approximate value 
of (he root. 

We have considered earlier various variants of the 
position of the arc of the curve depending on the signs 
of the first and the second derivative. 

ist case. The first and the second derivative are of the 
same sign, i.e. /' (.r) •/" (t) > 0. Assume, for instance, 
that f(a)<0, /(b)>0, /' (:i) > 0 and f (x) > 0 



198 


Computational Mathematics 


(Fig. 5.18 a). The graph of the function passes through 
the points Aq (a, f (fl)), B (&, / (6)). The required root of 
the equation f (x) = 0 is the abscissa of the point of 
intersection of the graph of the function y = / (x) and 
a:-axis. We do not know that point and, instead of it, 
take the point Xi of intersection of the chord 
the x-axis. And this is the app” imatc value of the root. 





Fig. 5.18 


The equation of the chord which passes through the 
points Aq and B has the form 


y— /(g) 


f(b)-f(a) - h-a • 

We seek the value of x----x^ for which 0: 

f(a)lb^a) 


Xj - - (I ~ 




( 1 ) 


The root g is now within the interval [j;|, b]. If the value 
of tlic root Xi does not suit our purpose, we can reline it, 
applying the method of chords to the interval [xj, b]. We 
connect the point Ai (x^, f (x^)) with the point B (6, / (b)) 
and find "’ 2 ^ which is t]ie point of intersection of the chord 
AiB and the x-axis: 


/(^i) jb-x,) 

f{b)-f{x^) • 


X ^ 
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Coniimiing (lus procoss, we obtain 

^ ^ f(^2) (^ — ^ 2 ) 

^ 3 - a:, f^b)-f^x,) 


and, in general, 

^n+l 


f i^n) ^n) 
f{b)-f{Xn) • 


( 2 ) 


The process goes on until we get the approximate root 
with the specified degree of accuracy. 

The formulas given above are also used to calculate 
roots Avhen / {a) > 0, / (b) < 0, /' (a:) < 0, f {x) < 0 
(Fig. r).l<S/;). 

2n(l case. The first and the second derivative are of 
unlike signs, i.e. f (r)-/" (0 <C Ih Assnni(‘, for instance, 




tliat / (a) > 0, / {/;) < 0, /' (.r) < 0, f {x) > 0 (Fig. 5.19 
a). We connect (he points A (a, / (a)) and Bq (6, / (ft)) 
and write the equation of the cliord which passes through 
the points A and 

y — f{b) ^ 
f{b)~f{a) ~b~a • 


We s(‘ek as the point of intersection of the chord and 
the .r-axis, setting y = 0: 


x^ — 


1{b) (6- a) 

m-m ' 


( 3 ) 


Tlu! root g is now williin llio interval [a, t,]. Applying the 
jnothod of chords to the interval [a, "^il, we get 

/l(*i)— /(“) 
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and, in general, 


f(xn) {Xn—a) 


( 4 ) 


Using these formulas, wo can also find the approximate 
value of the root when / (a) < 0, / (b) > 0, f (.r) > 0, 
r (x) < 0 (Fig. 5.19 b). 

Thus, if f {x) •f" (x) > 0, then the approximate root 
can bo found from formulas (1) and (2) and if f (a:)x 
f (x) < 0, then it can be found from formulas (3) and (4). 

However, we can choose the convenient formulas em- 
ploying the following simple rule: the stationary endpoint 
of an interval is the endpoint for which the sign of the func- 
tion coincides with the sign of the second derivative. 

If / (6) •/" {x) > 0, then the endpoint b is stationary and 
we can take the endpoint a as the initial approximation 
[formulas (1) and (2)]. Now if / {a)-f" (x) > 0, then the 
endpoint a is stationary and we must take the endpoint b 
as the initial approximation [formulas (3) and (4)]. 

Thus, as a result of the repeated application of formu- 
las (2) and (4), we get a monotonic sequence org, x.^, 
. , Xji which converges to the value of the root 
To estimate the error of approximation, we can use 
the formula 

li— ®nl< (5) 


where g is the exact value of the root and Xn-i and Xn 
are its approximations obtained at the {n — l)th and 
nth stages. It can be used when the following condition 
is fulfilled: 


M^2m, where M~ max \f' {x)\, m -^min \f {x)\, (6) 

[a. ft] [a. 6] 

Example 1. Use the method of chords to make the smaller root 
of the equation + 3x^ —3 = 0 accurate to e = 0.001. The roots 
of the equation have been separated and the smaller root is on the 
interval [—3, —2] (see Example 1 in 5.3). 

A We verify the fulfillment of condition (6): 

|/'(x)| = |3x2 + 6x|, 

M= max |/'(a:)l = |27-181=9, 

4 . 1 - 3 . - 2 ] 

m= min |/' (x)| = |12— 12| =0, M>2m, 

[- 3 . - 2 ] 

Wo take thojnidpoint of the interval [—3, —2], i.e. the point 
X = —2.5^ and choose the interval [—3, —2.5]. We again verify 
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the fulfillment of condition (6): 

M- max |/'(.r)|=9, /n= min I/' (a:) | = 3.75, 

[-3. -2.5] [-3, - 2.5] 

M >• 2m. 


Now we take the midpoint of the interval [—3, —2.5], i.e. 
the point x = —2.75; wo have / (—2.75) c 0, f (—2.5) > 0, 
/ ( — 3) < 0. We choose the interval [ — 2.75, —2.51 and find that 

M-~-- max 1/' (a:) I -=0.189, m= max | /' (.z) | = 3.75, 
[-2.75, -2.5] [-2.75, -2.5] 


i.o. in this case the condition M <C 2m is fulfilled. 

Thus, to estimate the error of the root lying on the interval 
[—2.75, —2.5], we can use formula (5): I ^ — aryi | < | j:,! -- I, 
i.e. we must continue the process of tlie successive approximation 
of tlio root until the condition I | < e is fulfilled. 

We determine the sign of the second derivative and find the 
formula which must he used for calculations. We find that /" (x) = 
Oz + 6. The inequalities / (—2.75) < 0 and / (—2.75)-/" (z) > 0 
hold true on the interval [—2.75, — 2.5]. This means that we must 
take X = — ^ 75 as the stationary endpoint of the interval. Then 
we must use jormulas (3) and (4) to carry out the calculations: 


fja) (h — a) __ f{xn) (xn — 

f{b)-f(a) ' f{xn)-l(a) 


where a —2.75 and / (a) = —1.111. If wo represent the last 
expression as 


Xn,\—Xn = 


f(xn) (Xn —a) 
1{Xn)-f(a) ’ 


we can at once get the difference of the two successive approxima- 
tions and verify whether we can terminate the calculations, i.e. 
whether the inequality | | ^ e is satisfied. 

It is convenient to use the following table to carry out she cal- 
culations: 

Table 5.3 


n 


•s! 

'n 

3'« 

cn fJ CO 
« 1 

11 .U 

« CO 

^ + 

.T„ - n 

d 

1 

'h 

2 

1 

c 

V. 

1 

0 

-2.5 

-15.025 

0.250 

18.75 

0.125 

0.25 

-0.025 

1 

-2.525 

-10.098 

0.3756 

19.1268 

0.0288 

0.225 

-0.006 

2 

-2.531 

-10.213 

6.4060 

19.2180 

0.0050 

0.219 

-0.0009 

3 

-2.5319 






1 



We can see from Table 5.3 that | Xg — | < 0.001 and, there- 

fore, rounding off to the thousands place, we get ^ = —2.532. 
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Example 2. Use the method of chords to make the root of the 
equation x — sin x — 0.25, which is on the interval fO, ji/2], 
accurate to e => 0.001. 

A We write the equation in the form x — sin a; — 0.25 -- 0 
and find /' (x) = 1 — cos x. To verify whether condition (6) is 
fulfilled, we compile an auxiliary table whose first two columns in- 
dicate the origin and the endpoint of the chosen interval of the 
separation of the root. 

Table 5.4 


a 

h 

Sl^MS of 

M 

ni 

Fulfill- 
ment of 
the con- 
dition 

Af < 2 m 

a -h f) 

2 

Sipn of 

/C'l;") 

fin) 

/ (?o 

0.00 

1.57 


+ 

1 .00 


no 

0.785 


0.785 

1.57 

— 

+ 

1.00 

0.2925 

no 

1.178 

+ 

0.785 

1.178 

— 

+ 

0.6172 

0.2925 

no 

('.982 


0.982 

1.178 

— 

■I- 

0.6172 

0.4446 

y(\s 




We see from the last row of the table that on I ho interval (0.982, 
1 .1781 tlie condition M < 2m is fulfilled. Consequently, when using 
the method of chords to estimate the error of the approximation of 
the root, we can employ the inequality I | < e. The 

root of the equation x — sin x — 0.25 = 0 is on the interval 
[0.982, 1 .178]. We determine the sign of the second derivative within 
the interval: 

/' j(r) = 1 — cos Xy r (x) — sin X >• 0. 


If we return to the old designations, then a — 0.982 and b = 
1.178. The sign of the second derivative coincides with the sign 
of the function at the point b. Consequently, this endiioint of the 
interval is stationary and all the approximations of ihv, root are 
from the side of the endpoint a. We use formulas (1) and (2) to 
calculate the root: 


l(a){b — a) ^ — 

/(&)-/(«) ’ f{b)-f(r„) 


whore b = 1.178, / (6) = 0.00416. We compile the following table; 


Table 5.5 


n 


1 

f ~ 

-sin - 0.2,^ 

'n 

/(*„)(« .v„) 

f (b) - / (,v„) 

(1 

0.982 

-0.83161 

-0.09961 

0.196 

0.189 

1 

1.171 

-9.92114 

-0.00014 

0.007 

0.0002 

2 

1.1712 






Thus X = 1,(71 with an accuracy of e = 0.001. ^ 
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5.5. Newton’s Method of Approximation 

Newton’s method is another method of iteration. 

Assume that the root of the equation j {x) = Q has been 
separated on the interval [a, h] and /' {x) and f {x) are 
continuous and retain constant signs throughout the 
interval [a, h]. 

In terms of geometry, the meaning of Newton’s method 
is that the arc of the curve y = f (x) is replaced by a 



Fig. 5.20 


tangent to that curve (hence, this method is sometimes 
called the method] of tangents). 

1st case. The lirst and the second derivative have the 
same sign. Let / (a) < 0, / (b) > 0, /' (x) > 0, /" (a:) > 0 
(Fig. 5.20 a) or / {a) > 0, / {b) < 0, /' (x) < 0, f (x) < 
0 (Fig. 5.20 b). We draw a tangent to the curve y = f (x) 
at the point Bq (/^ / (/;)) and hud the abscissa of the 
point of intersection of the tangent and the x-axis. We 
know that the equation of the tangent at the point 
^0 (^^ / (^^)) fl^G form 

y-f{b)=r {b) {x-b). 


Setting y = 0 and x = x^, we obtain 


X. 


f{b) 


r (h)' 


( 1 ) 


The root of the equation is now on the interval la, xj. 
Using again Newton’s method, we draw a tangent to the 
curve at the point (x^, / (xj) and obtain 


Xg - x^ 


/(^i) 
/' (^i) 
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and, in general, 

^n+l = Xn—-p^y ( 2 ) 

We get a sequence of approximate values Xn, . . 
Xn, • • -j every successive term of which is closer to the 
root ^ than its predecessor. However, all Xn remain larger 
than the exact root i.e. x^ is an approximate value of 
the root g by excess. 

2nr' case. The first and the second derivative are of 
unlike signs. Let / (a) < 0, / (b) > 0, f {x) > 0, /" (x) < 
0 (Fig. 5.21 a) or / {a) > 0, / {h) < 0, /' [x) < 0, f (x) > 



0 (Fig. 5.21 /r). If we again draw a tangent to the curve 
y = f (x) at the point B, it will cut the abscissa axis at 
the point which does not belong to the interval [a, 6]. 
We therefore draw a tangent at the point Aq (a, f (a)) 
and write its equation for this case: 

.V — / («) ^ f (^) — (O' 


Setting y — 0 and x = we lind that 

I (a ) 

r (a) • 


a- 




The root | is now on the interval [x^, b]. Using again 
Newton’s method, we draw a tangent at the point 
Ai / (^i)) 


x^ = x^ 


i(xi) 
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and, in general, 


^n+l ■— 


fi^n) 

r (^n)- 


(4) 


We get a sequence of approximate values 
. . each successive term of which is closer to the exact 
value of the root ^ than its predecessor, i.e. x^ is an 
approximate value of the root ^ by defect. 

Comparing these formulas with those derived earlier, 
we note that they differ only by the choice of the initial 
approximation: in the first case we assumed the end- 
point b of the interval to bo Xq and in the second case, the 
endpoint a. 

When choosing the initial approximation of a root we 
must be guided by the following rule: the endpoint of the 
interval [a, b] at which the sign of the function coincides 
with the zigii. .// the second derivative must be taken as the 
initial point. In the hrst case f[b)*f"{x)>Q and the 
initial point h = Xq, in the second case / (ft)'/" (x) >0 
and we take a = as the initial approximation. 

To estimate the error, we can use the general formula 

-Xytl * , where ^^min |/'(x)| (5) 

[a. b] 

(this formula can also be used for the method of chords). 
When the interval la, /;! is so small that the condition 
< 2ni^, wliere M 2 ” max | /" {x) | and = 

la, b] 

min I /' (x) 1, is fulfilled on it, tlu' accuracy of approxi- 

[n, 6] 

mation at the / 2 th stage is estimated as follows: if 


— a:„_i I < R then | g — x„ |< e^. 


If the derivative f (x) varies but slightly on the inter- 
val [ft, / 2 I, then, to simplify the calculations, we can use 
the formula 


Xn+i - x^ 


n^n) 

f'M ’ 


(6) 


i.e. it is sufficient to calculate the value of the derivative 
at the origin only once. In terms of geometry this means 
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that the tangents at the points {xn, / {x^)) are replaced 
by straight lines which are parallel to the tangent drawn 
to the curve y = f (x) at the point Bq (xq, / (x.)) 
(Fig. 5.22). 



Example i. Use Newton’s method to find the root of the equa- 
tion + 3x- — 3 0, which lies on the interval [ -2.75, —2.5] 

with an accuracy of e — 0.001. 

A We have established the fact that / (—2.75)*/" (x) > 0 (see 
Example 1 in 5.4). Therefore, to use the iiiethod of tangents, wo 
must choose Xq = — 2.75. We shall use formula (G) to carry out 
the calculations. We find that 


/' {x) - 3a:2 -1- Gt, /' (:ro) = /' (-2.75) - 6.1875. 

For the sake of convenience, we shall use Table 5.6, from 
which we can sec that \ x^ — ^4 I < 0.001, and, therefore, g — 
2.533. ^ 


Table 5M 


n 



4 

n 

34 


f (aCyj) 
6.1875 

0 

-2.75 

-20.797 

7.5625 1 

22. mi 5 

-1.111 

0.179 

1 

-2.571 

-16.994 

6.6100 

19.8300 

-0.164 

0.026 

2 

-2.545 

-16.484 

6.4770 

19.431 

-0.053 

0 .008 

3 

-2.537 

-16.329 

6.4364 

19.309 

0.020 

0.003 

4 

-2.534 

-16.271 

6.4212 

19.2636 

0.007 

0.001 

5 

-2.533 
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Example 2. Use Newton's method to find the root of the equa- 
tion X — sin X 0.25, which lies on the interval [0.982, 1.178], 
with an accuracy of e -- 0.0001. 

A Here wo have a — 0.982, h = 1.178. We find that /' (x) = 
1 — cos X, r W = sin a:> 0 on (0.982, i 178],/ (1.178)./" {x) > 0. 
Consequently, Xf^ = 1.178. Wo use formulas (1) and (2) and 
Table 5.7 to carry out the calculations. Wc can see from Table 5.7 
that I x.T — x.,\ < 0.0001. Thus £ 1.1712. ^ 

Table 5.7 


n 


- sin 

/ (^Jl) — 

- Sin 3C^-0.25 

/' (x„) 

= 1 - COS 

/ (*„) 

f (X„) 

0 

1.178 

-0.92384 

0.00416 

O.G1723 

-0.0065 

1 

1.1715 

-0.92133 

0.00017 

0.61123 

-0.0002 

2 

1.1713 

-0.92127 

0.()(M)03 

0 .61110 

-0.000^)5 

3 

1.17125 






5.6. The Combination of the Method of Chords and 
Newton’s Method 


The method of chords and Newton’s method yield 
approximations of a root from different sides and there- 
fore are often used in combination. Then the accuracy of 
the root increases much quicker. 

Assume that we have an equation / (a) = 0. The root 
^ has been separated and is on tlie interval [a, b]. Taking 
into account the type of the graph of the function we 
employ the combination of the method of chords and 
Newton’s approximation method. 

If f (x) •/" (x) > 0, then the method of chords yields 
approximations of the root by defect and Newton s method 
yields approximations by excess (Fig. 5.23 a and b). 

Now if f (x) •f" (x) <; 0, we can use the method of chords 
to get the values of the root by excess and Newton s method 
to get the values by defect (Fig. 5.24 a, ft). 

However, in all cases the true value of the root is be- 
tween the approximate values of the roots obtained by the 
method of chords and Newton’s method, i.e. there holds 

an inequality a < Xn < I < < b, whe^ Xn is the 

approximate value of the root by defee L and x^ by excess. 

The calculations must be carried out as follows. If 
f (a:)*/" {x) >0, then we must take the endpoint a as 
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0 a=jroJr, xz 


Fig. 5.24 

the initial approximation for the method of chords and 
the endpoint b for Newton’s method and then 

f(a){b—a) . Hh) 


The true value 

of the root is now on the interval [oi, 

6il. 

Applying the combined 

method to 

this interval, 

we 

n — n » 

/(«i) (b 


h 


UDtalll Ct2 — 


-/(aj) ’ * ■ 



and, in general, 






fMibn 

f(bn)- 

— «n) u 

f{an) ’ 

11 

(2) 

(see Fig. 5.23 a, 

b). 
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Now if f (a:)*/" (x) < 0, then we must take the end- 
point b as the initial approximation for the method of 
chords and the endpoint a for Newton’s method. Then 
we have 


— Cl 


f{a) 

/'(a) ’ 


6 


f(b)(b-a) 
f(b)-t(a) • 


( 3 ) 


Applying the combined method to the interval [oj, 6il 
we get 


and, in general, 


/(ai) 

/' (“i) 




'■n+l 


= a„ 


i M t 
/'(an)’ ®'*+‘ 


/(fci) (bi-g,) 

f(hn) (bn-an) 

f{b„)-f{an) 


( 4 ) 


(see Fig. 5.24 a, b). 

The combined method is very convenient for the eval- 
uation of the error of calculations. The process of 
calculation.? I.', terminated as soon as the inequality 


.c„ — Xn \ a ^ is satisfied. We must take 


? ^ i^n + (5) 

wlioro Xji and Xn are the approximate values of the root 
by defect and by excess respectively, as the approximate 
value of the root. 


Example. Use the combination of the method of chords and 
N<ivvton’s method to find the roots of the equation + 3x‘‘^ — 
24x +1—0 with the accuracy of 0.001. 

A (1) We separate the roots analytically, and have 

/ (x) = + 3x2 - 24x + 1, /' (x) = 3x2 + 6x - 24, 

i.e. the roots of the derivative are Xi = ~4 and x.^ = Z. Wo com- 
pile a table of signs of the function: 


X 

— no 

-4 

2 

+ c» 

Sign of / (x) 

— 

+ 

— 

+ 


The equation has three real roots: Xj 6 (—oo. —4), x, G (—4, 2), 
Xg 6 (2, +oo). We diminish the intervals of seeking the roots, 
making them equal to 1: 


X 

-7 

-6 

-5 -4 

~3 

-2 

-1 

0 

1 

2 3 4 

Sign of / (x) 

— 

1 

+ 

+ + 

+ 

+ 

+ 

+ 

— 

— + 


U-0104 
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Thus, xi 6 (—7, —G), j*2 € {0, 1), e (3, 4). 

(2) We use the combination of the method of chords and New- 
ton’s method to make the root lying in the interval (—7, — G) 

more precise and get / (—7) 27 <0, / (— G) -= 37 > 0, 

/' (x) — 3^2 Gx — 24 > 0, /" (.r) == Gj: -| G < 0, /' (x)-r (^) < 

0. 

We calculate employing formulas (4): 


'‘"7W 


^n+i 


/ i ^n) (^n ^7i) 

7(&n)-/K) 


i.o. 


an+i = «n + Aan. where 
^71+1 = ^71 + ^^711 where Ahn~ ~ 


fM 


/ (^7i) (^71 ^n ) 

f(K)-f{any 


(flyj and are the approximate values of the root by defect and 
by excess respectively). Here = « — — 7, = h = —6. 

It is convenient to carry out the calculations using a table (see 
Table 5.8). 

Taking into account that \ i = 0.0007 < 0.001, wo 

must terminate the calculations and lake 

li = -^ { - G.6384 - 6.0377) = — 6.638 


as the approximate value of the root 

(3) Let us estimate the approximate value of the root for the 

interval (0, 1). We have / (0) > 0, / (1) < 0, /' (x) — + 

6x — 24 •< 0, f" (x) = Gx + G > 0, j' (x)*/" (x) C 0. As in the 
first case, we use formulas (4) for Aq a = 0, 6 q — 1. 

We compifo a table (see Table 5.9). Thus we can take ^2 = 0.042 
with an accuracy of 0.001. 

(4) Let us now find the approximatt* value of the root belonging 

to tne interval (3, 4). We have / (3) —17 < 0, / (4) = 17 > 0, 

f (x) = 3x2 -|- 6x — 24 > 0, /" (x) = Gx -f- 6 > 0, /' (x)*/" (x) > 
0 . 

We use formulas (2) to carry out the calculations: 


^71+1 — ^71 


/ (^7l) '(^n ^Tl) 

I {bn) -f (an) 


/(bn) 
r (bn) 


9 


i.e. 


On+i = an+Ao„, where Ao„= — , 

7 (bn) / (aji) 

tn+i = fcn + A6„, where ' 

Here aQ = a = 3, = h = 

We reduce the calculations to a table (see Table 5.10). 
Thus we can take 63 = 3.596 with an accuracy of 0.001. jk 



Table 5.8 



0.6377 



Table 5.9 



0.0000 





















Table 5.10 



0.0000 
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5.7. The Iterative Method 

The gist of the method. The i(erative method, or the 
method of successive approximations, is one of the most 
important methods in computational mathematics. The 
main advantage of this method is that the operations 
carried out at each stage are of the same kind, and this 
makes it considerably easier to set up programs for a 
comp \ter which are based on iterative algorithms. 

Tlie gist of the iterative method is tlie following. Con- 
sider tlio equation 

/ (^) - 0 . ( 1 ) 

Let / (:r) be a function, continuous on the interval [a, b\ 
which vanishes within this interval at least at one point 
We have to find at least one of its real roots, which lie 
on [a, fe], with a specified accuracy. 

We replace equation (1) by an equivalent equation, 
i.e. l)y an equation which 1ms the same roots, say, by 
an equation of the form 

.r = (p (.1-). (2) 

We choose some value Xq g [a, h], say, (a \- b)l2, 

as the initial approximation. Then we calculate fp (.ro) 
and assume the resultant number = cp to be the 
first aiiproxiiritttion of the value of the root Substitut- 
ing jTi for X on the right-hand side of equation (2), we 
get a new number x^ — cp (a’l). Continuing this procedure, 
we arrive at a sequence of numbers .r„, x^, - ^ 

. . ., which are defined by the following relations: 

Xo = (fl + b)/2, x„ = (p (x„_i) (« = 1, 2, . . .)• (3) 

If there is a limit lim x„ = ^ and the function cp (x) is 

n->oo 

continuous, then we can pass to the limit in relation (3) 
and obtain 

l = cp a), (4) 

i.e. the limit ^ is a root of equation (2) and, consequently, 
of equation (1) as well. Since process (3) is convergent, 
for a sufficiently large n this root can be calculated with 
any specified accuracy. 
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Note tlial ilioro are infinitely many ways of arriving at 
representation (2) [i.e. at the form of the function (p ( 2 :)]. 
This is very significant since the form of the function 
q) (x) is of a considerable importance both for the con- 
vergence itself and for its rate (provided that the fact of 
convergence has been established). 

The following theorem defines the conditions for con- 
vergence of the iterative process (3). 

Theorem. Assume that the following conditions are ful- 
filled: 

(1°) the function cp (x) is defined and differentiable on the 
interval [a, &], 

(2°) all the values of cp (x) ^ fa, 6] for x g [a, 6], 

(3°) there is a number ^ < 1 such that 

1 9' (x) i < g < 1 ( 5 ) 


for X ^ [a, ^J. 

Then the iterative process (3) converges irrespective of 
the choice of the initial approximation x^^ g [a, 6] and 
lim a:,, is the unique and simple root of the equation x = 

n-*-oo 

(p (.f) on the interval [a, b], 

□ We set up tlie following differences: 

I ‘^0 I I ^0 I » 

1-^2“ ^il - — ^ 1^1“ ^ul 

I '^3 - ■'T, I - I 9 (‘^ 2 ) — 9 (^ 1 ) ! -- I (^ 2 ) I • 1^2 “ 1 

TqI » 


I ~ ^n-1 1 KP (^n-l) — V (^n- 2 ) I 

(^n) I * l^n -1 •^71-2! ^9 -^ol* 

Here c,, g by virtue of condi- 

lioii 2". 

Consider a series witli the following partial sums: 

*^71+1 “ 'i' (H — ^’ 0 ) “I' (^2 ■^’ 1 ) I' • • • 
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It is evident that Sn+i = series Xq + ^ — 

i=0 

Xi) is convergent since all of its terms beginning witli 
do not exceed, in absolute value, the terms of 
the geometric progression with a common ratio g < 1. 
Hence there is a limit 

lim lim Xn = l. 

n-^oo n-»oo 

Sli ce the function q) (x) is continuous, we have 
lim (p (x„_i) = (p (I) and since a:„ = qi (^n-i)> if follows 

n-^oo 

that (p (5) = i.e. | = lim Xn is a root of equation (2). 

n-*-oo 

Let us prove that this root is unique. Let and I2 
two roots of equation (2), i.e. = cp (li) and ^2 = 
(p (Sa)- Then 

I ^1 — ^2 I = I 9 ( 5 l) — (P (S2) I 

= lq>' W l-Ui -^2 K (6) 

where c ^ (li, ^2)* We reduce relation (6) to the form 

Ui - ^2 I (1 ~ I cp' {C) I) = 0 

and then it follows from condition 3 ° that 
the two roots are not distinct. 

Let us finally prove that the root obtained is simple. 
To do this, it' is sufficient to prove that x — cp (x) lias a 
derivative which does not vanish at any point of the 
interval la, b]. Indeed, {x — (a:))' = 1—9' {x), and 

it is evident, by virtue of condition 3 °, that this expression 
is positive on la, &]. ■ 

The estimate of the error. Consider the difference of 
the exact and the approximate value of the root 

15 — ^nl = l<p{ 5 ) — <P(a:n-l)Kgl 5 — 

— 9|5 ^n- 1 1^915 ®nl”l~ 7 l^n '^n-l I • 

From this we have 

15 — ^ni 

Relation ( 7 ) makes it possible to find, already after the 
first iteration, the maximum number of iterations N (£), 
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necessary to calculate ilio root with the specified accuracy 
c. Indeed, for | ^ — j',^ | to be not larger than e, it is 
sufficionl that 


whence we have 


1^1 




log 

For q 1/2, the estimate of the error becomes simpler 
and assumes the form 

I I l< |.rn !. (9) 

We have mentioned that the form of the equation x = 
(p (x) is of importance for the convergence of the iterative 
method. We shall now show a sufficiently general tech- 
nique for constructing the function (p (x), for which the 
fulfillment of condition 3"^ of the theorem is ensured. 

Let us consider tlie initial equation / (x) = 0. Assume 
that there is a unique root ^ of the equation on the in- 
terval (^, 6] and that the derivative /' (,i) exists for 
X f [a, b] and retains sign so that 

nil /' (x) ^ Ml, where Mi = max /' (x); 

[n, b] 

nil = t' W (19) 

[a. b] 

(without loosing general i I y, we can assume that /' (x) > 

0 ). 

We replace the equation / (x) = 0 by an equivalent 
equation 

X = X — V (‘^) (11) 

and choose the constant X which would ensure the ful- 
fillment of condition 3°. 

For the function cp (x) = x — Xf (x) condition 3° is 
written as follows: 

ii --xr{x)\<i 

We solve this inequality and have — 1 < 1 — Xf (x) < 
1. From the right-hand inequality we find that X >0 
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and from Iho left-hand one we get K < 2//' (.r), i.o. 
0 < < 2//' (x), X 6 la, b\. 


or 

0 < A, < 2/Mi. 

We usually assume to be X. Thus we get an 

equation 




f(x) 

Ml ’ 


( 12 ) 


and tlie corresponding iterative process has the form 




Ml * 


(13) 


Reasoning by analogy, we can show that in the case 
/' (x) •< 0 and 0 < ^ \ f' (^) I we got an 

equation 


x-—x-\- 


m 

Ml 


( 12 ') 


and the corresponding iterative process assiiinos the form 





(13') 


We assume now that in addition to condition (10) wo 
have a relation 

Ml < 3m,. (Ki) 


Then we may require (hat the inequality \ 1 — Xf'{x) | 

1/2 should he satisried. Solving it, we get tlie following 
restrictions for %: 


1 

2m I 



(15) 


Geometric interpretation. Consider an equation / (x) ^ 
0 [/ (x) is a continuous function]. We reduce tliis equation 
to the form x == cp (x) and construct the graphs of the 
functions y = x and y = (p (x). The abscissa of the point 
of intersection of the graphs of these functions is the 
true root ^ (Fig. 5.25). 

We choose Xq 6 b] and determine cp (xq). We designate 
the sequence of points lying on the curve y ~ if (x) as 
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~ 1, 2, . . .) and Llic soqiiciico of points lying 

on the straight lino // = .r as 1, 2, 3, . . .). From 

the point yig (Xf^, cp (xq)) we draw a straight line, parallel 
to the X-axis, until it cuts the line y = x, and get a point 

Hi {Xi, cp (xo)). 

JndooH, A^Cf) = ^) (xo) = .since II B^Ci || 

AqCq. But OCi = BiCi (AOCJii is ri<rhl-aii!fled and 



I'ii;. 5.25 Fiji. 5.26 


iso.scclos since (lie lino y is tlie bi.seclor of (ho coor- 
(linate angle), (bnsequontly, f'l ~ <p (‘Tq). 

We draw || and, repeating the arguments 

presented above, make sure that Xo — (p (x,). 

Figure 5.2,") shows a convergent iterative process. The 
curve cuts the bisector y x at the point M with abscissa 
^ and, for x > g, lies under the bisector, and (p' (x) atis- 
lies the condition 0 <; cp' (x) C 1. Tlie successive ap[)rox- 
imations x^, x^, . . x„, . . . (the common abscissas of tlie 

points of tlie graplis of the two functions) decrease mono- 
tonically. Each successive approximation x^ is closer 
to the true value of the root than its predecessor x„_i. 
The polygonal line . . . has the form of a 

staircase. 

In Fig. 5.20 Ihe derivative q)' (x) < 0 but is smaller 
tlian unity in absolute value, i.e. | (p' (x) | < 1. The 
iterative process converges but the approximations oscil- 
late about tlie exact value of tlie r^ot. The polygon. T 
line /lo/yi.di/ia/t a • • • form c. a spiral. 

Thus, if in some neighbourhood (a, b) of the root S 
of the equation x = (p (x) the derivative q)' (x) retains 
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constant sign and the inequality | cp' (:c) | g << 1 is 
satisfied, with cp' (x) >0, then the successive approxi- 
mations 2, . . .)» ^0 6 b] con- 

verge to the root monotonically. When cp' (x) < 0, the 
successive approximations oscillate about the root 
Figure 5.27 shows a divergent iterative process. Here 
cp' (.r) >1. The curve cuts the bisector y = x Ri the point 
M and lies above the bisector for x > 




Figure 5.28 illustrates a divergent iterative process for 
the case | cp' (x) | >1. The successive “approximations” 
recede from the exact value of the root 

Example 1.' Use the method of iterations to find the root of the 
equation — 20x -f- 3 = 0, lying on the interval [0, 1] with 
an accuracy of 10 “^. 

A We must reduce the equation to the form x = tp (x). There are 
several ways of doing this, for instance, 

x = x-\-(5x^ — 20j:+ 3), then = — 19a: +3, 

x = v'(20*— 3)/5, then q), (*) =v^( 20 x— 3)/5, 
a: = (5a:3 + 3)/20, then tpg (a:) = (5a:3 + 3)/20. 

Let us find out which of the functions obtained must be used to 
calculate the successive approximations. Recall that if (p (x) 
satisfies the condition | <p' (^) I ^ 9 < f the interval [a, 61 , 
then the iterative process converges. We find that 

|q>;WI = 115x2-191 >1 on [ 0 , 1 ], 

I (pi (x) I = 15x2/20 = 3x2/4 <1 on [0, 1]. 

Consequently, we can use the function (pg (x) and the iterative 
method to seek the successive approximations from the formula 
x„ = (5x5^., -f- 3)/20. We take max 9 ' (x) on [0, IJ, i.e. x® = 0.75, 
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as the initial approximation. We employ formula (7) to find the 
difference between two successive approximations necessary for 
the specified accuracy to be achieved: 


I ^ 


0.0001.(1—0.75) 0.0001 .0.25 


0.75 


0.75 


0.00003. 


Thus, when the absolute value of the difference I ““ I 
does not exceed 0.00003, the iterative process must be terminated 
and the specified accuracy assumed to be achieved. 

It is convenient to use the following table to carry out the 
calculations: 

Table 5.11 


n 


4 

n 


0 

0.75 

0.42188 

0.25547 

1 

0.2555 

0.016777 

0.154144 

2 

0.1.541 

0.0it5652 

0.151413 

3 

0.i5i4 

0.005443 

0.151301 

4 

0.1513G 

0.005442 

0.151361 


At this stage the iterative process may be terminated and 
^ -- 0.1514 may bo assumed to be the needed accuracy. ^ 

Example 2. Calculate the root of the equation o'' — — q 

with an accuracy of e = 10“^. 

A Wo rewrite the equation as t-^ ~ and separate the roots 
by graphical means. We construct the graphs of tlie functions 



y = e* and y = (Fig. 5.29). It can be seen from the drawing 
that the equation e''^ — “ 0 has one real oot which lies on the 

interval [—0.8, — 0.7). 

Let us verify whether it is really so We find / ( — 0.8) and 
f (-0.7) and have / (-0.8) - 0.44933 - 0.64 = -0.19067 < 0, 
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/ (-0.7) 0.49659 — 0.49 - 0.00659 > 0. Since the signs of the 
lunclion / (.r) — e*^’ - .r- are difforont at the endpoints of the 
interval [—0.8, - -0.7], the root of the equation is within this 
interval. 

I.et UvS make the interval narrower ojiiploying the trial and 
(‘iTor method. We find tliat / (- 0.75) = 0.49237 — 0.56250 < 0 

and / (— 0.7) > 0. This means that the root is on the interval 
[—0.75, 0.7], We make the interval narrower still. We have 
/ (-0.725) -- 0.48432 — 0.52562 - —0.4130 < 0 and / (-0.7) > 
0. Consequently, the root is on the interval [—0.725, - 0.7]. 

From the equation ^ x- we find that x = — 1 e^ (we take 
the minus sign before the radical since we know that the root is 
negative). We rewrite the equation as x — and find out whether 
the iterative process is convergent or divergent, i.e. whether the 
inequality | q)' (jr) | < 1 is satisfied. In this example 

(p {x) = — (p'{x) = (1/2) e^^2^ I cp' (-0.725) | - 0.34727, 

I (p' (x) I = I cp' (-0.7) I - 0.35230. 


Since | cp' (.c) | < 1, the iterative process converges. We take 
the number q in formula (7) equal to 0.36. Since e — 10"^, it follows 
that 


l-^n, 71-1 1 ^ 


0.00001(1 — 0.36) 
0.36 


0.000618. 


Thus the required accuracy will bo achieved when the inequality 
I Xn — ^ 71-1 I < 0.00002 is satisfied. We can take any one of the 
endpoints of the interval [ -0.725, —0.7] and any point within 
it as the zero approximation. We assume that Xq = —0.7. 

The calculations can be reduced to the following table: 


Tabh‘ 5 U 


71 


V 


n 

-0.7 

-0.35 

-0. 70460 

1 

-0.70460 

-0. 35230 

- 0.70307 

2 

-0.70307 

-0.35154 

-0.70360 

3 

-0.70360 

-0.35180 

- 0.70342 

4 

-0.70342 

-0.35171 

-0.70348 

5 

-0.70348 

-0.35174 

-0.70346 

6 

-0.70346 




Since \xe — xr^\= \ -0.70348 - (-0.70346) | =0.00002, the 
required accuracy of the calculations has been achieved and E ^ 
-0.7034f\ A 

Example 3. Employ the iterative method to calculate the root 
of the equation + 3x^ — 3 = 0, lying on the interval [—2.75, 
—2.5], with an accuracy of 0.001 (see Example 1 in 5.4 ancl Exam- 
ple 1 in 5.5). 
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A Wc find that (a:) 3.c~ | Bx. Consequently, 

Mi= max I/' (.7)1 -6.189, w, -- min I/' (t) I - 3.75, 
[-2.7.'), -2.r3j [-2.75, -2.5] 


/rii 

'aYT 


1 


3.75 

6.1~89 


1 


Since q C 1/2, wo can use formula (9) to evaluate the error. We 
assume that = G and then X = 1/6 and 

(p (a:) = X — Xf (x)~x (a;3 -| - 3a:- — 3) . 

The corresponding iterative process has the form 

^ — 3) , 

i 

then — — 3). The caleulalions should be 


terminatoJ as soon as I x 


71+1 


-• I < e. 


We redu^’f' the calculations to the following table: 


Table 5.13 


7L 



o 

3M 

4 - (x^ -f* 3.x2 - 3) 
b 

0 

-2.5 

-15.625 

18.75 

U.II2 

1 

-2.52 

-16.0030 

19.0512 

0.(HI80 

2 

-2.5280 

- 16.1559 

19.1724 

n.i'Mi 2 .s 

3 

-2.5308 

-16.2096 

19.2148 

o.0( II i8 

4 

-2.5316 





Thus vve can assume ^ — —2.532 to be the approximai.' value 
of the root with an accuracy of 0.001. 


5.8. General Properties of Algebraic Equations. 
Determining the Number of Real Roots of 
an Algebraic Equation 

General properties of algebraic equations. Wc write 
an Aith-degree algebraic equation 

Pj, (x) - UqX^ + 1- . . . f 0, fl) 

where (x) is an //tli-degreo polynon al, n is the liigliest 
degree of the unknown, and Oo, flj, . . are real coef- 
licients. 
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We know that every number | whicli turns the poly- 
nomial into zero, i.e. sudi that (1) = 0, is a root of 
the polynomial. 

The number ^ is a root of the polynomial Pn (^) if and 
only if Pji (x) is exactly divisible by :r ~ Recall that 
if Pn (x) is exactly divisible by {x — {k ^ 1), but is 
not divisible by (x — then | is a A-fold root (or a 

root of multiplicity k) of the polynomial P^ (^). Roots of 
multiplicity k = i are simple, or single, roots of a 
polynomial. 

The following llieorem, which wc give without proof, 
answers the question whether every polynomial has roots. 

Theorem 1 (the fundamental theorem of algebra). Every 
polynomial with any numerical coefficients whose degree 
is not lower than unity has at least one root, which is complex 
in the general case. 

There is an important corollary of this tlieorem: every 
polynomial (a:) of degree n {n^ \) with any numerical 
coefficients has exactly n roots, real or complex, if every 
root is reckoned as many times as is Us multiplicity. 

Thus the roots of the algebraic equation (1) may be 
real as well as complex. 

The complex roots of equation (1) possess the property 
of being pairwise conjugate, i.e. if equation (1) has a com- 
plex root ^ = a -f pi (where a and p are real numbers) 
of multiplicity k, then it also has a complex root | = 
a — pi also of multiplicity /c. These roots are of the same 

absolute value: | ^ | = | ^ | = P“. 

If equation (1) has complex roots, then their number is 
even. Therefore every algebraic equation of odd degree 
with real coefficients has at least one real root. 

Before calculating the roots of an algebraic equation, 
we must: (a) determine the number of roots that equation 
has, and (b) find the domain of existence of the roots 
(establish the upper and the lower bound to the roots of 
the equation). Then we can proceed with determining the 
roots and making them accurate to a certain value. 

Determining the number of real roots of an algebraic 
equation. We can find out how many positive real roots 
the algebraic equation (1) 

Pn (x) = -f- + • • • + a„_iX + = 0 
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possesses approximately, applying Descartes' rule of 
signs: the number of positiue real roots of the algebraic 
equation Pn (x) = 0 with real coefficients (each of which is 
reckoned according to its degree of multiplicity) either is 
equal to the number of sign changes in the sequence of the 
coefficients of the equation (x) = 0 or is less than the 
number of sign changes by an euen integer (the coefficients 
equal to zero are not reckoned). 

The number of negative roots of the equation is equal 
to the number of sign changes in the sequence of coeffi- 
cients of Pj^ ( — x) or is smaller by an even integer. 

If an equation is complete, then the number of its 
positive roots is equal to the number of variations of 
sign in the sequence of coefficients or is smaller by an 
even integer and the number of negative roots is equal to 
the number of constancies of sign or is smaller by an 
even inttgei. 

Example 1. Kind the number of positive and negative roots of 
the equation — ilx^ -j- 12 j:^ + Ix^ — a: + 1 =0. 

A According to the fundamental theorem of algebra, this equa- 
tion has five roots (at least one of which is real). 

The equation is complete, the soquemee oi signs of the coeffic- 
ients being |-. There are four sign changes and 

this means that there are either four or two positive roots or there 
are none. 

The number of sign constancies is 1, and, consequently, the 
equation has one negative root. ^ 

Example 2. Find the number of positive and negative rf -d roots 
of the equation x^ — 3j'‘ -\- x^ -|' — f — 0. 

A This equation has six roots; 'the sequence of signs is , — , 
+ , — . There are three sign changes, and, consequently, there are 
either three positive roots or there is one root. Furthermore, for 
the polynomial 

Pn (—^) = -I- X- — 1 

the sequence of signs is 4 , We also have three changes 

of sign here and, therefore, there are either three negative roots 
or one. 

Sturm's theorem allows us to lie more precise in deter- 
mining the number of roots of an algebraic equation. 

Since we can always separate the multiple roots of an 
equation and the common roots of the .qualions (o’) = 
0 and P'n (x) = 0, we can assume witliout loosing gene- 
rality that the equation P ^ (^) = 0 lias only simple roots. 


15-0104 
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Suppose we have established in some way that all the 
real roots of the algebraic equation (x) = 0 are in the 
interval (a, 6) (a and b are real numbers and are not roots 
of the equation, a <C b). We find the first derivative 
Pn (x) and divide the polynomial Pj^ (x) by it. We take 
the remainder of the division of P^ (>^) by P^ (x) with the 
opposite sign and denote it by /?i (j:). 

Then we similarly divide P'^ (x) ])y (x), take the 

reiiiainder obtained with the opposite sign and denote it 
by /?2 (x). Dividing B^ (x) by B^ (x) and again taking 
the remainder with the opposite sign, we get Bg (x). We 
continue the process of division until we get a remainder 
which is a constant quantity. We take that quantity also 
with the opposite sign. 

The result is a sequence of functions 

(^), P'n W, ^^1 {x), /?2 (.r), . . -/?„_! (a:), 

Bjn = const, 

which is known as Sturm s system. We substitute first a 
and then b for x in this sequence and count the number of 
sign changes in both cases [we designate the numbers 
obtained as W (a) and W (b) respectively]. 

Theorem 2 (Sturm’s theorem). If the real numbers a 
and b {a <.b) are not roots of the polynomial P ^ (x)j which 
does not have multiple roots, then W (a) ^ W (b) and the 
difference W (a) -~W (6) is equal to the number of real 
roots of the polynomial P^ (x) which lie between a and b. 

Sturm’s theorem can be utilized to find the number of 
negative roots of the equation P^ (x) = 0 [i.e. the num- 
ber of real roots of the equation P^ (x) = 0 in the interval 
(— oo, 0)1 or the number of positive roots [in the interval 
(0, +oo)]. Sturm’s tlieorem is also used to separate 
roots. The functions entering into Sturm’s system can be 
multiplied and divided by arbitrary positive numbers. 
This simplifies the calculations considerably when divi- 
sion with a remainder is carried out. 

Example 3. Find the number of real roots of the equation 5x^ — 
20x + 3 = 0, and also separate those roots utilizing Sturm’s 
theorem. 

A We set up a system of Sturm’s functions. We have (x) = 

— 20a; + 3, P'n (a:) = 15a;^ -- 20. To determine Ri (or), we 
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multiply Pyj (x) by 3 and then divide it by (x): 


X 


15j;2 — 20 


15x3 — 60x+9 
^15x3 ^ 20x 


— 40x+9 


Hence (x) = 40x — 9 (the remainder is taken with the 
opposite sign). We multiply P'n (x) by 8 and divide the product by 
Ri (x): 


3x+27 


40x — 9 


120x2 — 160 
120x2 ^ 27 x 


40 (27X-160) 


40. 27x — 40.160 


=F40.27x± 9.27 


Since the last remainder is a constant quantity with the minus 
sign (and in this case we are interested particularly in the sign 
of the remainder), we change it to the opposite, i.e. to the plus 
sign. 

We compile the lollowing table of the signs of the functions 
which enter into Sturm’s system: 


X 

Pjt M 


Ri ix) 

fit 

W (' > 

— oo 


+ 


+ 

3 

0 

+ 

— 

— 

+ 

2 

— [^ oo 

+ 

+ 

+ 

+ 

0 


We can see from the table that there are three real roots in the 
interval (— oo, +oo) [since W (— oo) — W '+oo) = 3 — 0 = 3J. 
One of them is negative [W ( — oo) — IT = 3 — 2 = 11 and 
two are positive [ly (0) — W (+oo) = 2 — 0 = 2). 

Utilizing Sturm's tneorem, we separate the roots diminishing 
the intervals to the length equal to unity: 


15 * 
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X 

Pn (v) 


(X) 

U» (*) 

W(x) 

— oo 

_ 

+ 

_ 

+ 

3 

-3 

— 

+ 

— 

+ 

3 

-2 

+ 

+ 

— 

+ 

2 

-1 

+ 


+ 

+ 

2 

{) 

+ 

— 


+ 

2 

1 

— 

— 

+ 

+ 

1 

2 

+ 

+ 

+ 

+ 

0 


We can see from this table that the roots lie in the intervals 
(-3. -2), (0, 1) and (1. 2). 4 

5.9. Finding the Domains of Existence of the Roots 
of an Algebraic Equation 

Rule of annulus. Assume that we have an algebraic 
equation 

Pj, (a;) = a^^ + a^x^-^ + a^x^^^ + . . . + 

-j- fln ~ 

where ao, fli, ...» fln coefficients^ and let A = 

max {1 ai j, \.a.^ | 1}, 5 = max {[ a^ |, 1 |, 



• • •» I ^n-i I}- Tf^en the roots of the equation are in the 
annulus r < | j: | < i?, where 

1 . D A \ ^ 

l + B/la„| ’ |a«l • 

Here r is the lower bound and R is the upper bound of the 
positive roots of the algebraic equation P„ (z) = 0 and 
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— i?, — r are the lower and the upper bound of the negative 
roots respectively (Fig. 5.30). 


Example 1. Determine the bounds of the roots of the equation 
- 20x + 3 = 0, 

A Here|flol=5, ^ = 20, |a„|=3, J5 = 20, i.e. 

fl=l+-T^==H-^ = 5; 


1 




1 + 20/3 23 


^ 0.013. 


Then, if the real roots of the equation 5a;® — 20a: + 3 = 0 exist 
(and they are sure to exist since the equation is of an odd degree), 
they lie in the interval ( -5, 5), the negative roots lying in the 
interval (—5, —0.013) and the positive roots in the interval 
(0.013, 5). A 


When solving equations, it is convenient first to estab- 
lish the t)ounds of the roots and then use Sturm’s theorem. 
The rule of annulus makes it possible to find the approxi- 
mate bounds of the roots. 

The technique given below allows a more precise esti- 
mation of the bounds of the real roots of the algebraic equa- 
tion Pr, (x) = 0. 

If /?! is the upper houFid of the positive roots of 
Pn the upper bound of the positive roots of 

Pj^ ( — x), /?3 >0 is the upper hound of the positive roots 
of x^Pn (lAr) and is the upper hound of the positive 
roots of x^Pj, ( — I/t), then all the nonzero real i >its of 
the equation (x) = 0 (if they exist) lie with- . the 
intervals —^IB^) and (l//? 3 , /?i). 

To find the upper bound of the positive roots of an 
algebraic equation, we can make use of Lagrange’s or 
Newton’s method. 

Lagrange’s method. If the coefficients of the polynomial 

Pji (^) 4 4- • • • 4- fln 

satisfy the conditions flo >0, a^, ...» c^m-i ^ 

< 0, then the upper bound of the positive roots of the 
equation {x) = 0 can be found frr-v, the formula R --= 
1 +”{/ B/Uf^y where R us the greatest of the absolute values of 
the negative coefficients of P^ (^)» 
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Example 2. Use Lagrange’s method to determine the bounds 
of the positive and negative roots of the equation 8x^ — — 

32a: + 1 = 0. 

A Here Aq = ^ ^ 0, Aj = 0, a 2 = — 8 <0, ^3 = — 32, — 
1, m = 2 (the number of the first negative coefficient), B = 32. 
Consequently, = 1 + V^32/8 = 3. 

Let us consider the polynomial 

(—x) = 8x4 _ s^2 32x + 1. 

We find by analogy that the upper bound of its positive roots is 

R, i + Vm = 2 . 

Furthermore, for the polynomial 

x^P^ ( 1 /x) = x4 ~ 32x3 - 8 x 2 + 8 

we have Aq = 1 > 0, Aj = —32 < 0, i.o. m = 1, 5 = 32, Rn == 
1 + 32 = 33. 

And for the polynomial 

x4p„ (-1/x) = x4 + 32x3 - 8 x 2 + 8 

we have Aq ^ 1 > 0, a^ = 32, Aj = — 8 , A 3 = 0, A 4 = 8 , i.e. 
m = 2 . Therefore, J ?4 = 1 + /s = 1 + 2/2 = 3.828. 

Consequently, if the equation 8x4 „ gx® — 32x +1 — 0 has 
real roots, they are sure to lie in the intervals (—2, —1/3.828) and 
(1/33, 3). 4 

Newton’s method. // for x ~ c the polynomial 

Pr^ (x) = a„z" I- + a„ 

and its derivatives Pn {^) P"n (^), ... assume positive 
values, then c is the upper bound of the positive roots of 
the equation Pj,^{x)— 0. 

Example 3. Use Newton’s method to determine the upper bound 
of the positive roots of the equation 8x4 „ 8 x 2 ^2x +1 — 0 . 

A We find that 

P (x) == 8x4 — 8 a :2 _ 32x + 1, P' (x) = 32x3 - l()x — 32, 

P" (x) = 96x* — 16, P'" (x) = 192x, P^^ (x) = 192. 

We must verify the values of x > 0. For x = c = 1 we have 
P (1) < 0. This means that we may not continue the verification 
for X = 1 Let us verify the value x — c = 2: P (2) > 0, P' (2) > 

0, P" (2) > 0, P"' (2) > 0, > 0. Thus the number 2, 

1. e. i? = 2, is the upper bound of the positive roots. We can take 
the inverse of the number i?, i.e, r = 1/2, as the lower bound. 4 
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5.10. Horner’s Method of Approximating Real Roots 
of an Algebraic Equation 


Consider an algebraic equation 

P (.r) = |- 1- • • • h (1) 

where ^21 • • •» coefficients of the polyno- 

mial. Wo have to find the real roots of this equation. 

We represent the required root of the equation, written 
in the decimal notation, in the form 

X - Co - 10’^ + Cl . 10"^-! + c. • + 

... |-C;i.lO’”-M' ... 

Horner’s method consists in tlie successive determi- 
nation of the digits of tlic root c,), Ci, ... by means of 
special transformations of equation (1). 

If we employ the substitution x = 10’^^ (for Co >0) 
OT X = (for Co < 0), then we reduce equation 

(1) to an equation 

/i il) - r -t- -t- . . . + a; - 0, 

whose root is in the interval (0, 10). Therefore, in what 
follows we sliall consider this particular case. This sim- 
plifies the process of computation of the root although it 
is not obligatory for the employment of Horner’s method. 

Since 0 < X < 10, the root of equation (1) -.'n be 
written in the form 


X 


- r L -£L 4- ^2 

" ^0 ' r 4l^ ^ 


10 


102 


^3 

103 


- C0C1C2C3 . . 


It is easy to find the first digit c^ of the root either by 
the table method or by tlie use of the interval (a, 6] of 
separation of the root. 

Next, applyin^f the tran.sformation 

x —Co = y ( 2 ) 

to equation (1), we find that x — y whence it fol- 

lows that 


P {x) = P (// -h c„) = — (p (j/) = 0. 


(3) 
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The number y — 0, ... is evidently the root of 

the last equation. Applying^ the substitution 

y = y/io (4) 

to equation (3), we arrive at an equation 

Pi {Y) = 0, (3') 

whose root is Y = iOy = Ci,C 2 Cq .... Equation (3') 
yields the digit which is the second digit of the root 
of equation (1). Then we can again apply substitutions 
of types (2) and (4), but this time to equation (3'). As a 
result we get an equation 

P, (Z) = 0, (5) 

whose root is the number z =* Cg, Cg . . .. Then we find 
the digit C 2 - 

This procedure can be repeated until we get the required 
number of digits. Horner’s method can bo used in com- 
bination with some otlier method, say, the chord metliod, 
Newton’s method, or the combination of those two meth- 
ods. We first find several iligits of the root by Horner’s 
method and then use other methods to make a closer 
approximati'on. 1 

When we have to obtain a small number of the digits 
of the root, we can use the following technique. 

If one of the roots of the equation is considerably smal- 
ler than the other roots, then it can be approximately 
calculated by means of ftie division of the constant term, 
taken with the minus sign, by the coefficient of the first 
power of x. 

How can substitutions (2) ami (4) bo carried out in 
practice? 

To make substitution (4), we must multiply the coef- 
ficients tti, ag, . . ., a„ of the initial equation by 10, 10^, 
10®, . . , lO’^ respectively. 

Substitution (2) must be preceded by the expansion of 
the polynomial^ (x) in the powers of x — Cq, for which 
purpose we can use either Taylor’s formula or the fol- 
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lowing relations: 

P (x) = (x) (x — Cg) + r„, 

<7i (^) = Qi (x) — Co) + rj, 

</2 (^) = '7.3 (-c) (x — c„) + '-2, (6) 


'7n-2 W "= '/n-l ix) (x — C„) + r„_2, 

'7,1-1 (^) == — c„) + r„_i, 

where (j:) and are, respectively, the quotient and 
the remainder of the division of 7 i_i (x) by (j: — Cq). Suc- 
cessively eliminating Qi (.r) from relations (6), we arrive 
at an identity 

P (x) = (x — Co)'‘ )- r„_i (x — Co)"-^ 

+ '■,>-2 (■>: — Co)""^ + . . . f Tj (x — c„) -h r„, (7) 

i.e. obtain an expansion of / (:*;) in the powers of x — c^. 
Horner's scheme can be used to calculate each of the 
remainders (i = 0, 1, . . ., — 1), i.e. the coefficients 

of the expansion. 

The system of equalities (6) corresponds to the table 


fll 

flo 



fln-1 

On 

fcl 

62 

1 ', 


^n-i 

ro 


^2 

^3 




r n-i 







wliere -- l-c„, 0. -- Vo, 63 = = 1 

^2 — ^V(}y ^3 = • • •• If il^<‘ coefficient of is a, 

Ihen we must write Uo I'ulher Ilian unity in the first 
column. 

Example. Use Horner’s method to find the smallest root of the 
equation + 3x^ — 3 — 0 with six significant digits. The roots 
of the equation have been separated and the smallest of them is 
on the interval [—3, —2], 

A (1) Since the root is negative, we transform the original 

/X/ 

equation by means of the substitution x = — x: 

— *» + 3x* -3 = 0, or "x* - 3x> -4- 3 = 0. 
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The required root of the equation x 6 [2, 3]. Consequently, the 
first digit of the transformed equation is 2. Then substitutions (2) 

and (4) have the form x — 2 — y and y = y/lO. We use Horner’s 
scheme to make the first substitution: 


cq — 2 


1 

-3 

0 

3 

1 

-1 

-2 


1 

1 


1 





According to formula (7), we find from this table that cp (y) — 
-h 3y ~ i and (Y) -- |- 30y2 — 1000 -- 0. 

In what follows, we can use the table to write the two trans- 
formations together, retaining the designation of f/, i.e. instead of 

the last relation we shall write Pj (y) = £/* + 30y^ — 1000 -- 0. 

Wo shall find the values of the polynomial (y) for certain 
values of y 6*[0, 10] using Horner’s scheme: 


y 

1 I 

30 

0 

-1000 

5 

1 

35 

175 

-125 

fi 

1 

36 

1 210 1 

1 290 


Since Pi (5) < 0 and Pi (6) > 0, it follows that y ^ [5, 6]. Hence 
Cl = 5. 

(2) To find tho'noxt digit, wo set up an equation whose coeffic- 
ients are obtained from Horner’s scheme, employing substitution 
(2) and (4) for 5: 


Cl = 5 


1 

30 

0 

- 1000 

1 

35 

175 

1 -125 

1 

\ 

40 

375 



Thus p 2 (y) ^ y^ + AbOy^ -f 37 500// - 125 000 = 0. 
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We seek the values of (y) for certain values of y 6 [0, 10] 
using Homer’s scheme: 


y 

1 ^ 

450 

37 500 

-125 000 

3 

1 

453 

38 859 

-8423 

4 

1 

454 

39 316 

32 264 


Since (3) < 0 and P.^ (4) > 0, it follows that y 6 [3, 4]. Hence 
fa = 3. 

(3) We derive an equation for determining the next digits 
whose coefficients can be found from Horner’s scheme: 


fa — 3 


1 

450 

37 509 

-125 090 

1 

453 

38 859 

1-8 423| 

4 

L 

456 

[W2ff\ 

1 

1 45>) 




Hence Pg (y) = y^ -h 4590^2 + 4 022 lOOy - 8 423 000 - 0. 

Wo can apply a special technique described above to the equa- 
tion obtained. As a result of a three-fold substitution (4), all the 
roots, except for the rcMpiired on(‘, have increased approximately 
10'^ times. Then the root of the last erjuation is approximately equal 
to 8 423 000/4 022 700 2.09. This means that I hi' digits 2, 0 

and 9 are the next decimal digits of the root of the original equation. 
As a result we find the root of the given eciuation, it is X = 
-2.53209. 4 

Exercises 

1. Use analytical means to separate the roots and calculate 

them with an accuracy of O.OOl. Employ the trial and error method, 

(a) — x + 1 ~ 0, (b)^T2 -|- 2.T — 4 = 0, (cl -}- 5x — 3 = 0, 

(d) 2.2x - 2* - 0, (e) 2* - 2r2 - 1 0, (f) 2-'^ - 4x - 0. 

2. Use graphical means to separate the roots and calculate 
them with an accuracy^)! 0.001. Employ the chord method: 

(a) + X — 3 -= 0, (b) x3 H 8.r - fi - 6, (c) -f- lOx - 9 - 0, 

(d) x2 — ■ cos jxx = 0, (e) x2 — sin Jtx = 0, (f) log x — -1 ^ 0. 

x2 

3. Use Newton’s method to find the roots of the following 
equations with an accuracy of O.OOl: 

(a) x3 — '6x2 + 9x - 3 = 0, (b) — 12x -- 8 = 0, 

(c) -t- 4x* - 6 = 0, (d) 2 log x — f- i = 0, 

(e) x2 — 20 sin x = 0, (f) x — cos x = 0. 
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4. Use the combination of the chord method and Newton's 
method to find the roots of the following equations with an accuracy 
of 0.001: 

(a) + 6x — 5 0, (b) — 2x + 7 = 0, 

(c) — 2a:a + X + 1 = 0, 

7 

(d) 1.8 t® — sin lOx = 0, (e) log x — = — 

Zx o 

(f) 2x In X — 1 =0. 

5. Employing Sturm's theorem, separate the roots of the equa- 
tions and calculate them with an accuracy' of 0.001 using the itera- 
tive method: 

\‘\) -[■ — 3 ~ 0, (b) X* — 2x — 1 = 0, 

(c) X® — 5x -1-2 = 0, (d) x4 4 - X — 3 = 0. 

6. Use the iterative method to find the roots of the following 
equations with an accuracy of 0.001: 

(a) In X + (x + 1)® = 0, (b) x -f- 1 = 1/x, (c) x — cos x = 0, 



Chapter 6 


The Eigenvalues and 
Eigenvectors of a Matrix 


6.1. The Characteristic Polynomial 


Consider a square matrix A and a nonzero column 
vector x; 






flu fli2 • • 

• ^171 


Xa 

fl21 ^22 • • 

. fl2n 

, X = 

o.m • • 

• ®iin_ 


_ _ 


Multiplying the matrix A by the vector x, we obtain a 
column vector 


i.e. 



LynJ 


y = ^x. 


( 1 ) 


If the coordinates i/f (i = 1, 2, . . n) of the v ,tor y 
prove to be proportional to the respective coordinates xt 
of the vector x, with the proportionality factor i.e. 
if yi == Xxi, and, consequently. 

y = (2) 


then the nonzero column vector x is an eigenvector of the 
matrix A and the proportionality factor X is an eigenvalue 
(or characteristic value) of the matrix A, Since y = 
and y = Xx, it evidently follows that 

i4x = Xx. (3) 


Thus, if condition (3) is fulfilled, then the vector x is 
the eigenvector of the matrix A corresponding to its 
eigenvalue X. 
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Example 1. Assume that 
A 

Then 

Ax 


ri2 3] i] 

= 26 -2 , x= 1 . 

La 4 -ij Ll 


'1 2 3] rn r6] ri' 

= 26—2 1 = 6=61. 

-3 4 — ij Lu L^J Ll 


Consequently, the number A, — 6 is an eigenvalue of the matrix A 
since equality (3) is satisfied: 


Ax 


"r 

= Xx = 6 1 
_1_ 


and the vector x = 


is an eigenvector of the matrix A corre- 


sponding to the eigenvalue A, = 6. 

We rewrite relation (3) in the form .4x — = 0, or 

{A — XI) X = 0, (4) 


where I is an identity matrix of the same dimension as 
the matrix A and 0 is a zero column vector. It is evident 
that without the factor / in the product X/, equation (4) 
would be meaningless. 

Since 



K 0 0 .. 
0X0., 

. . 0 
. . 0 

, 0 = 

0 

0 


0 0 0., 

.X 


0 


we can write equation (4) as 


Cii’-X 

fll2 

' • ^171 

021 

022 — ^ 

. . 0271 

^ni 

0^2 

• • ^nn X 





0 


^2 



0 


Xji 


0 


( 5 ) 


Relation (5) is a homogeneous linear system of equa- 
tions which has nonzero solutions if and only if its deter- 
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minant is zero, i.e. when tho condition 

del {A — X/) = 0 (6) 

is fulfilled. 

Equation (fi) is a characteristic equation of the matrix A 
and its left-hand side is a characteristic polynomial (or 
characteristic determinant) of the malrix A. 

We can also write out the cliaracteristic equation as 
follows: 


flu — 

X fli2 

. . flin 



fl21 

fl22 — k , , 

. . 02/1 

= 0. 

( 7 ) 

flni 

®R2 

^nn k 




If w'e expand the determinant on the left-hand side of 
equation (7^, we get a polynomial of the nih degree with 
respect to A: 

D (k) = det {A ^ U) 

= - . . .+(-irp„]. (8) 


The quantity k, found from equation (8), assumes n 
values ^ 1 , ^ 2 , . . kj^, among which equal values may be 
found. To lind the eigenvectors which correspond to 
the eigenvalues A./ (/ == 1, 2, . . n)^ we must solve the 

homogeneous linear system of equations (5) for each 
value ki. 


Example 2. Find the eigenvalues and eigenvectors of the ma- 


trix A — 



A (1) We write the characteristic polynomial of the matrix A 
and find k. We have 


det(>l-A/) = 


2-k 

1 




The characteristic equation -f 3 = 0 has two roots ki=i 

and Aj == 3, which are tho eigenvalues of the matrix A, 

(2) Wo seek the eigenvector x(^)=r^^^ corresponding to Uie 

L^2- 

value X,i = l. The matrix equation 

(^-Xi/)x(‘)= 0 , or 2^1] K] = [o] 
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is equivalent to the system / ^ which has an infinite 

number of solutions of the form a:i= — Xg- Setting Xi = c (c is 
any number), we get ^2 = —c. Then the required eigenvector can 

be written as x(0 ~ ^ [ 1 J • 

(3) We seek the eigenvector corresponding to the 

second eigenvalue ^2 = 3. We liave 

2-3 1 


(i4-V)x<*> = 0, or 


1 2—3 


] [::]=[o]- 


This matrix equation leads to the system | ^ 

I ^1 — ^3 — ” 

lencc 

Lis m 

[ 1 ] 


whence it follows that Xi = X 2 . Setting xi = c, we find that X 2 = c, 
This means that the second eigenvector has the form x(2) = 


When eigenvalues and eigenvectors of matrices are 
sought one of the following two problems must be solved: 
( 1 ) all the eigenvalues and the corresponding eigenvectors 
of the matrices must be found, or ( 2 ) one or several eigen- 
values and the corresponding eigenvectors must be 
determined. 

The first problem consists in expanding the characteris- 
tic determinant in an nth-degree polynomial (i.e. in 
finding the coefficients pi, /?2» • • •» Pn) stnd calculating 
the eigenvalues ^1, X2, , , Kn and, finally, finding the 
coordinates of the eigenvector = (otj, Xg, .... Xn)- 

The second problem consists in finding the eigenvalues X 
(one or several of them) using the iterative methods, 
without expanding the characteristic determinant. 

The methods of the first problem arc exact, i.e. if we 
apply them to matrices whose elements are defined exact- 
ly (by rational numbers) and carry out precise calcula- 
tions (according to the laws of operations involving com- 
mon fractions), we shall get the exact values of the coeffic- 
ients of the characteristic polynomial and the coordinates 
of the eigenvectors will be expressed by exact formulas 
in terms of the eigenvalues. 

The eigenvectors of a matrix can usually be determined 
with the user of the intermediate results of the computa- 
tions carried out to find the coefficients of the characteris- 
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tic polynomial. It stands to reason that to find an 
eigenvector corresponding to a certain eigenvalue, this 
eigenvalue must be already calculated. 

The methods of solving the second problem are iterative^ 
i.o. the eigenvalues are obtained here as the limit of some 
number sequences as well as the coordinates of the eigen- 
vectors corresponding to them. Since these methods do 
not require the calculation of the coefficients of the 
characteristic polynomial, they are less labour-consuming. 
In what follows we consider some methods of expanding 
a characteristic determinant and the iterative methods 
of finding the eigenvalues of a matrix. 

G.2. The Method of Direct Expansion 

Jjel us consider a third order malrix in order lo under- 
stand how the coefficients of a characteristic polynomial 
can be ^‘oui d by a direct expansion of a cliaraci eristic 
determinant. Let 

flu ai2 ai3 dll — ai2 flja 

A--- d 2 \ 022 ^23 , det (yl — XI)- 021 ^22 — X (I 23 

-® 3 l ^32 ^31 ^32 ^33 X 

We use the rule of triangle to calculate the determi- 
nant: 

a^i- X ai 2 013 

det (>l — XI ) <*21 <*22 — X 023 

<*31 <*32 <*33 X 

' — (^11 (^22 (^.33 “H ^12^23^31 ^13^32^21 

® 13^31 (^^22 ^ 12^21 (®33 ^23^32 1 1 

- —X^ I A2(aii-l-a2. + <Z33)--^^[(a,l«22 — «l 2 « 2 l) 

-\~ (^22^33 ^ 23 ^^ 32 ) (^11^33 ®13^3i)l (^11^22^33 ^12^23^31 

<^13^32^21 ^13^22^31 ^12^21^L3 ^23^32^11 

„(_ (a., +»„+»„)+>. (1^; ;;; 





<*11 

<*12 

<*13 

<*22 

<*23 

^ <*11 <*13 1 \ 

<*21 

<*22 

<*23 

<*32 

<*33 

<*31 <*33 1 / 

<*3l 

<*32 

<*33 _ 


or 

det (A — XI) = (— IP (A,'* — piA“ + — Pa) ^ 0. 


16-0104 
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The coefficient Pi here is the sum ol tlie diagonal elements 
of the matrix A, It is known as the trace of the matrix 
and is designated as Tr 

Pi = i r = ^11 a 22 ■[" 

tlie coefficient pg is the sum of all the principal minors of 
the second order of the malrix A: 


P2=--- 


fli] ai2 
O21 0,22 


®22 ^23 I 

^32 ^33 


All Aia 

®31 ®33 


(recall that the principal minors of the second, the 
third, ... the /?th order are minors the elements of whose 
principal diagonals are the elements of the principal 
diagonal of the determinant det A); the coeflicient 


Pa ^ det A == 


Ajl ai2 fll3 
A 21 ^22 ^23 
^31 ^32 ® 3 S 


In general, we have to expand the determinant det (/I — 
kf) in an nth-degree polynomial 


z? (X)= _(i)"[r-p,r-‘+p,r-2- . . . -1- (- i)v„i 

then the coefficients pj, P2, • • Pn found from 

the following formulas: 


Pi = S aii = Tr A which is tlie sum of all the dia- 
4=1 

gonal elements of the matrix A, 


Pi = S 


a<P 


O-aa 

^P (3 


which is the sum of all the prin- 


cipal minors of the second order of the matrix A^ 


^aa ®ap ^aV 

~ ^ flpa app flpY 

a'^P<V 

principal minors of the t 


which is the sum of all the 


lird order of the matrix A. 


det A which is the determinant of the matrix A, 

The number of principal minors of order /r of the mat- 
rix A is 


// 2 \ ^ n{n- l)(n — 2 } ... (n — k-\ \) 2 

\k } /cl 


n). 
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The method of direct expansion is very labour-con- 
suming and is only used to find the characteristic poly- 
nomials for low-order matrices. 


Example 1. Use the method of direct expansion to find the char- 
acteristic polynomial of the matrix 


-4 -3 1 n 



L 1 1—1 — iJ 


(1) We find that 

Pi — fr A — ail “1“ ®22 ^33 ®44 “ 


-4 + 0 4- 2 - 1 = -3. 


(2) We have ^ • The number of second-order 


a<fi 


principal minors of a fourth-order matrix is ^ ^ = 6 . 

Writing out all tlit;se minors and adding them together, we get 



a=l; 3=2 a=l; 3=3 a=l; 3=4 a— 2; 3=3 



a=2, 3=4 a=3; 3=4 


«aa fla3 ^av 
fl 3 a ^315 
flya ®V3 ^VV 


The number of 


(3) We have p^— 2 

a<3<v ’ 

third-order principal minors of a fourth-order matrix is ^ 3 ) = 


4-3-2 

1*2.3 


= 4. Consequently, 


P 3 -- 


-4 -3 1 


-4 —3 1 


-4 1 1 

2 0 4 

+ 

2 0-1 

+ 

1 2 2 

1 1 2 


1 1 —1 


1 —1 —1 


a=r. 3=2; v=3 


+ 


a=l; 3=2; v=4 

0 4-1 

1 2 —2 
1 —1 —1 


(x=l; 3=3; 7=4 


= 24 . 


a=2; 3=3; v=4 


16 * 
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(4) And finally we find that 


P4 = det A -- 



— 15 . 


(5) The final result is 

D (A,) = + pjjA,® — pjA, + P4 

= k* + 3A,» - 7A,a - 24A, - 15. A 
Example 2. Expand the characteristic polynomial of the matrix 



and find any of the eigenvalues and the corresponding eigenvector. 
A (1) We have 


P2^ E 

a<p 


P^ = TtA = 3 — 1 — 2 = 0; 


^aa ®ap 



a— 1; p=2 a=i; 3=3 a-^2; 3—3 


= 1-6 + 2= -3; 


Pg = det A = 


3 1 0 

-4 —1 0 

4 -8 -2 


— 2 . 


Consequently, D (X) = (—1)^ (k^ — 3A. + 2), — 3X + 2 - 0. One 

of the eigenvalues of the matrix A is X = 1. 

r^i'l 

(2) Let us find the eigenvector x = I Xg corresponding to X = 1. 


The matrix equation 


(A-X/)x = 0 , 



is equivalent to the system 

r 2Xi+ Xg =0, 

< — 4xi — 2x2 = 0 , 

t 4 xi — 8x2 — 3x3 = 0. 
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The first and the second equations are proportional here and, 
therefore, discarding the second equation, we get a system 

/ 2xi-\-x^ = 0 , 

\ ^ Xi — 80:2 — 3 a :8 = 0. 


2 1 I 

The minor d= ^ __g ~ “20 is a base minor, x^ and x^ 

are base unknowns, x^ is a free unknown. Using then Cramer’s rule, 
we find that 


di 

0 

2x^ 

1 

8 

3^:3 

d 

-20 


21) 

^2 _ 1 

2 0 

4 3x3 


6x3 

d 

-20 


-20 • 


Setting 0:3 = 20, we find that 0:1 = 3, 0-2= —6. Thus x(^) = c —6 

L 2f) 

is the required eigenvector. 

6.3. Krylov’s Method of Expansion of a Characteristic 
Determinant 

Krylov’s method is based on the properly of a square 
matrix to turn its characteristic polynomial into 
zero. 

According to the Hainilton-Cayley theorem, every 
square matrix is a root of its characteristic polynomial 
and, consequently, turns it into zero. 

Let 

/)(^)-det(^-A,/) 


= ( - 1)" (r + + pX'-^ + . . . + Pn) (1) 

be a characteristic polynomial of the matrix A. Replacing 
the quantity K in relation (1) by A = [cz/y] (where / = 1, 
2, , , n, f = 1,2, we obtain 


+ p,A^i + p^A^^ + . . . + A = 0. 


( 2 ) 
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We take an arbitrary nonzero vector 



Si \d postmultiply both sides of relation (2) by 

^"y( 0 ) +...*+ = 0 . ( 4 ) 

Now we set 

^y(ft-i)=.y<'*)(/c=l, 2 n), (5) 

i.e. 

y(l) = ^y<0), 

y(2)=^y(t) = 42y(°>r 

y(") = ^y"-i = 

Then relation (4) assumes the form 

y^"”’ + + /? 2 y‘"”^^ + . . . + Pny<®> = o, (6) 

or 

Piy<""‘^+Piy<”~^> + Pny^°^ = — y<”^ 

or 
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i.c. 


PiV\ 


’ + -f- • • • + Pnyi"’ = 




Piyi" *’ [-PiVi' + = —1/2”’, 

PlJ/k”-'’ + P2y'n”-®’+ .. . 
or, finally, in matrix form 


( 7 ) 


r y[n-i) y(n-2) 


formulas 


1/'.*' I 


Pi 

P2 


!/'2"’ 

k® ’ . 


- Pn- 


-yk"’ - 

. . . , 

can be 

found 


(8) 


ai^yr = ^y«». 


n 


yi“’ = 21 fflijyi" = 

;=l 


( 9 ) 


yr = S a;;yr‘’=- .ly(”-‘)(i=l, 2, 

i=l 




the coordinates of the initial vector (3) being arbitrary. 
If the linear system (7) has a iiniqiio solution, then its 
roots Pi, P 2 , . . Pii are the coefiicients of the charerteris- 
tic polynomial (1). We can use Gauss’ elimination to 
find this solution. 

Example 1. Use Krylov’s method to expand the characteristic 
determinant of the matrix 
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Table 6.1 


Pi 

P2 

j^m 

P4 

Constant 

terms 

2l 

22 


12 

-5 

-2 

-4 

B 

1 

0 

0 

0 

-120 

47 

23 

43 

-150 

64 

33 

53 


1 




40/13 

50/13 




-2/39 

-5/39 

-1/3 

20/39 

11/39 

-1/3 

-189/13 

-141/13 

3 

-168/13 

-121/13 

3 

-168/13 

-121/13 

3 


1 



-53/5 

-56/5 

— 56/5 



|-1/15| 

-1/3 

-1/3 

1/3 

33/5 

3 1 

31/5 

3 

31/5 

3 



1 

5 I 

j -99 

-93 

-93 




a 

-30 

-28 

-28 




1 

-15 

-14 

-14 

1 

1 

1 

1 

174= -15 

/7s = -24 
P2=-7 

Pi = 3 

/74 = - 14 

Ps == 23 

P2= -6 

Pi = 4 

-14 

-23 

-6 

4 
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(2) Using formulas (9), we determine the coordinates of the 
vectors y(fe) = Ayih-^) (k — 1, 2, 3, 4): 


y(i)==^y(ft) = 


y(2)^^y(l). 


y(3) ^y(2) , 


'-4 

-3 

1 

r 


"1“ 


- 

-4" 


2 

0 

4 

-1 


0 



2 


1 

1 

2 

-2 


0 

■ ' 


1 

t 

- 1 

1 

-1 

-1- 


J)_ 


- 

1- 


-A 

-3 

1 

1" 


” 

4“ 


r 121 


2 

0 

4 

— 1 



2 


— 

5 


1 

1 

2 

-2 



1 


— 

2 


- 1 

1 

— 1 

— 1_ 


- 

1- 



4- 


-4 

-3 

1 

r 


r 121 


~ 

39 

1 

2 

0 

4 

— 1 


_ 

5 



20 

1 

1 

2 

-2 



2 



11 

- 1 

1 

-1 

— 1- 


_ — 

4- 


_ 

13 

j 


y(4) = ^y(3). 


! 

CO 

1 

i 

1 


'-39" 


" 120" 

2 0 4 —1 


20 


-47 

11 2-2 


11 


-23 

- 1 1—1 — 1- 


- 13- 


--43- 


(3) Then we set up a matrix equation 


— 39 12 

-4 r 


Pi 


- 120" 

20 —5 

2 0 


P2 


-47 

11 -2 

1 0 


P3 


-23 

- 13 4 

1 o_ 


-Pi 


_-43- 


and write a system of form (7): 


- 39/?i -I- 12p2 -- + Pi- 

20pi— bp^-\-2p^ = M, 
llpi— 2p2+ = 

13pi— 4p2+ Pz = ^3. 


- 120 , 


We solve this system using Gauss’ elimination (see Table 6.1). 
Thus we have 

D (k) = det (A -U) =- I* -}- pik^ + p^K^ + + Pi 

- H- - 7A,2 - 24A, - 15. £ 

Now if the linear system (7) doe^ not have a unique 
solution, the initial vector must be altered. 
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Example 2. Use Krylov’s method to expand the characteristic 
determinant of the matrix 


A = 


A (1) We take y(®) = 


y(l) = ^y(0) = 


y(3) = >ly(2) : 


“1 

-1 -1 2" 



2 

3 0—4 



1 

1 —2 —2 

• 


-1 

1 0 -1- 



“r 




0 




0 

as the initial vector £ 

-0_ 




"1“ 



■ 0“ 

2 

1 

; y(2)=^Xy(2)==, 

4 

— 1 

-1- 



- 2- 

-1“ 



“-1" 

4 



6 

2 

; y(«) = /ly(3) 

= 

-3 

-2- 



- 3- 


(2) We set up a matrix equation 


'1 0 1 r 


"pr 


' r 

4 4 2 0 


P2 


6 

2-110 


P3 


-3 

1 

o 

CSI 

CM 

-J 


LpaJ 


- 3- 


whence we obtain a system of equations 

{ Pl+ P3+ 

^Pl + ^P2 + 2p3 = — 6, 

2pi— P2+ P3 = 3, 

2pi + 2p2+ P3=— 3. 

We solve this system using the scheme of unique division (see 
Table 6.2). 

Since tne pivot element is zero, it is impossible to continue the 
calculations using this scheme. 

(3) To obtain the unique solution, we change the initial vec- 
“ 0 “ 

tor. Setting q we find that 

LlJ 
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‘ 2" 


r 


— 4 


— 4 

y(l) = yly(0) = 

— 2 

; y(*) = .4y(i) = 

4 



--1- 


- — 1 

J 


” 4" 


"10‘ 


y(») = ^y(*) = 

4 

— 4 

; y(«) = Ay(») = 

8 

10 

. 


- 3- 


- 5- 



The matrix equation 


- 

4 6 2 O'] ■ 

4 _4 —4 0 

—4 4—20 

. 3 — 1 — 1 1- - 

Pil 

P2 

Ps 

P4-J 

'10' 

8 

10 

- 5- 

Table 6.2 

PI 

Pt 

P3 

P4 

Constant 

terms 

2i 

22 

m 

4 

2 

2 

0 

4 

-1 

2 

1 

2 

1 

1 

1 

0 

0 

0 

1 

-6 

3 

-3 

1 

4 

4 

5 

2 


1 

0 

1 

1 

1 

4 



B 

-1 

2 

-2 

-1 

-1 

-4 

-2 

-2 

-10 

1 

-5 

1 

-12 1 

-3 

-6 

1 

! -12 

-3 

-6 


1 

-0.5 

-1 

-3 

1 

-3.5 

-3.5 



-1.5 

0 

-3 

0 

-2 

1 

-6.5 

1 

-6.5 

1 


1 

1 

2 

1.333 

4.333 

4.333 




B 

1 

1 

1 








CO to 
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leads to the system 

{ 4pi + 6p2 + 2p3 — — 1' > 

4Pi — 4pa— 4p3 =— 8, 

-4pi + 4pa-2p3 =-10 

3pi— Pa— Ps + P4=— 5, 


or 


2pi + 3p2 + p» 

Pi Pa Pa 

— 2pi + 2p2 — P3 

3pi— Pa— PS + P4 


— 5 . 

- 2 , 

-5, 

-5, 


Table 6.3 



CSI OQ 
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which can be solved with the use of the scheme of unique division 
(see Table 6.3). 

Consequently, 

D (X) = X* — 2Xa I- 3> - 1. A 

6.4. Using Krylov’s Method for Calculation 
of Eigenvectors 

If the coefficients Pi, P 2 » • • •» Pn the roots 

A .4 of the characteristic polynomial are known, 
then Krylov’s method makes it possible to find the corre- 
sponding eigenvectors from the following formula: 

x(^) + . . . 1 - g„_,, i y(®> 

{ir-. i, 2, n). ( 1 ) 

Here y^^^ are vectors used for seeking 

the coellicicnls P 2 » • • Pn by Krylov’s method and 

the coefficients (y = 1, 2, . . — 1, i = 1, 2, . . ., /i) 

can be found using Horner’s scheme: 

<l}i = Kg}-ut+P)- ( 2 ) 

Example. Use Krylov’s method to find the eigenvectors of the 
matrix 

1 —1 —1 2" 

_ 2 3 0—4 

^-1 1 _2 -2 • 

-1 1 0 — 1 . 

AThe characteristic polynomial of the matrix A is known: 

det {A - KI) 2X^ + 3X ~ 1 

(see Example 2 in 6.3) and the eigenvalues are = Xg = i» ^3 = 
0.618, X 4 = — 1.618. To find the eigenvectors, we use for- 

Table 6.4 



ro == 1 


1 

P2= - 2 

Vs = 3 

Ki = i 
>12=1 
>.3 = 0.018 
^4= “1.618 

9oi = l 
9o2=1 
9o8 — 1 
9o4 = 1 

,,1 = 0 
912 = <> 

9i3= ““ 
Q\4 = " 

0.382 

-2.618 

,21= -2 
,jj== -2 

,„= -2.236 
,24 = 2.236 

931 = 1 

9s8 = 1 
,33=1.618 
,34= -0.618 
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mula (1): 

x(i) = y(3) + q^^yi 2 ) + + q^.y(0)^ 

Here q^i = 1 and the coefficients gjid -- 1, 2, 3, i — 1, 2, 3, 4) 
can bo found with the use of Horner’s scheme (see Table 0.4)* 

We employ the expressions for the vectors y(®), yO), y(2), y(3), 
which we have found in Example 2 in 0.3, and obtain 



6.5. The Leverrier-Faddeev Method 

This method was suggested by Leverrier and then sim- 
plified by the Soviet mathematician Faddeev. The meth- 
od of Leverrier is based on Newton’s formulas for the 
sums of the powers of the roots of an algebraic equation 
and consists in the following. Assume that 

det = r + ...+Pn 


( 1 ) 
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is a cliaracloristic polynomial of the malrix A = [aij] 
(wliero / 1, 2, . . A?, / = 1, 2, . . A?) and Xy, 

Xj^ is a complete s(‘t of roots of polynomial (1). Consider 
the sums 

+ (* 1, 2, ri), 

i.e. 

X^ -j- Xo + . . . -]r “ Tr A , 

- K + K+----\-K--Tta^, 

(each sum *S\ is a trace of the matriv A^^). Tlien, for //. 
there hold Newton's jorruulas 

^h'r PiSk--i \- •••+Pfe-i*S'i — kpf^, 

wlience we find that 

Pi- for k- \ 

Pi — ^ (5.1 f p^S^) for k 2 

( 2 ) 


Pn ^ (5^ 1 Pi5n-l r p2^7i-i • • • i' Pn-\^\) ^ 

Consequently, the coeflicieiils of the characteristic 
polynomial Pi, p.^, . • Pn can be easily found when the 
sums . . ., *S’n are known. 

Thus Leverrier’s scheme for seeking a characlerislic 
determinant is the following: 

(1) w(‘ calculate the powers A^ = (}' = 1, 

2, . . h), 

(2) we iind the sums Sf^ which are the sums of the 
principal elements of the matrices A^. 

(3) and then we use formulas (2) to lind the coefhcieuts 

P. (/• = li 2 n). 

The modilied Leverrier method, suggested by Faddeev, 
consists in calculating the sequimce of matrices Ai, 
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I 2t 


An according to the following scheme: 
Ai = A, Tryl, ^gr,, Bt -^At — qJ, 


A.,=--AB 


Aji-i ^ ABji_2 


Tr/lj 
»’ 2 

Tr Aji^x 
n — 1 


^2? 


B,^-A,-qJ, (3) 


^n-l ^71-1 771-1^7 




(Jn, Bn ~ An — qnJ {^n is a zero inatix) , 


7i Pi 7 72' — P 27 


7/1-1 P/i-17 Qn - Pn‘ 


Example 1. Use the Leverrier-Faddeev method to expand the 
characteristic determinant of the matrix 


A = 


1 
2 
1 

LI 

A Wo successively obtain 
(1) A,^A = 


i -1 2 

3 0 —4 

1 —2 -2 
1 0 ~1. 


Bi=^ Ai — Qil — 


1 - 1-1 2 
2 3 0 —4 

1 1 - 2—2 
Ll 1 0 —1 

0 —1 —1 2 
2 2 0 —4 

1 1 -3 -2 

Ll 1 0 — 2J 


, q,--.TTA, = i \ 3-2-1 


(2) .42 = .4Pi ■= 



'1 -1 1 2' 


"0 -1 -1 2' 


2 3 0 —4 


2 2 0 —4 

— 

1 1—2—2 


1 1 3-2 

1 - 

.1 1 0 — 1- 

-2 2 4T 


-1 1 0 -2_ 


2 0—2 0 
-2 -3 5 6 

L 1 0—1 OJ 

-3 -2 


Tr^lg — l+0-f5-f-0 
2 ~ 2 


: 2 . 


B 2 — A 2 Q2^ — 


2 4' 

2 —2 —2 0 

-2-3 3 6 

1 0 —1 - 2 . 
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“10 0 O' 

0 10 0 _ T1M4 _ 1 + 1 i-l-r-l 

0 0 1 0 ’ 4 4 

J) 0 0 1. 

0 0 0 (T 
0 0 0 0 

~qj= ,) 0 0 — O4. 

j) 0 0 0. 


(5) Thus Pi - 
3, /J4 = ^4 ““ 


= “ qi 

— 1 


“ 1 » P2 ~ ^2 “ P3 — Q3 — 

and D (X) - -- k^ — 2 k'^ + ^ 6 k—\. £ 


The modification of Leverrioi*\s method, suggested by 
Faddeev, makes it possible to hiid the inverse matrix A'^. 
From formulas (3) we have /!„ = ~ — 

(/„/ 0;i, whence it follows that Aj, = q„J, or 


Ih'emultiplying relalion (4) by we oblain A '^ABj^ „j = 
whence we find tliat 



17-0104 




( 5 ) 
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Example 2. Calculate the inverse of the matrix A given in 
Example 1. 

A Using formula (5), we obtain 


^-1 = 



' 23—1 - 6 ' 
— 4 —7 2 16 

1 2-1-4 

-—2 —4 1 9- 


Verification: 


'1 —1 —1 21 


2 3—1 —6] 


ri 0 0 on 

2 3 0 -4 


—4 -7 2 16 


0100 

1 1-2-2 


1 2—1—4 


0010 

-1 1 0 1. 


--2—4 1 9_ 


-0 0 0 1. 


A 


6-6. Using the Leverrier-Faddeev Method 
for Calculation of Eigenvectors 

If the matrices Z)\, B2, . . obtained by the 

Leverrier-Faddeev method and the roots Xj, Xg, . . 
of the characteristic polynomial D (X) are known, then 
the eigenvectors can be found from the formula 

X(h = + . . . + 

where e is a unit vector and b^, bg, . . b,i^i are column 
vectors of the matrices B2, . • B^-i ol the same 
order as e. • 


Example. Calculate the eigenvectors of the matrix 





if the matrices B^ (see Example 1 in 6.5) and the eigenvalues 

A-i = ^2 = 1, >.• = 0.618, Xi = — 1.168 of the characteristic 
polynomial D {%) — 2X® + 3^—1 are known. 


A We take c = 

■()■ 

0 

1) 

and then hi = 

' 2' 
-4 
— 2 

» hg — 

1 

0 

1 


A. 


-—2- 


L-2J 


"- 6 “ 
16 
-4 
- 9- 


(the fourth columns of the matrices Bg, Bg). From the 
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formula x(*) = ^5e+X?bi + X/ba + b 3 we find that 


x(i)=x(2) = 


'0* 


“ 2" 


■ 4“ 


— 6' 


"0 “ 

1) 


—4 


0 


16 


12 

0 

+1- 

— 2 

+1- 

6 


—4 

— 

0 

_ 1 _ 


-—2- 


- — 2- 


- 9- 


-6 . 



We tabulate the results of the calculations as follows; 


Table 6,5 


h 

I 

II 

III 

IV 

V 

VI 

— A-a = 1 

0 

0 

0 

1 

2 

-4 

-2 

-2 

4 

0 

6 

-2 

-6 

16 

-4 

6 

0 

12 

0 

6 

(I 

1 

0 

0.5 

A.s = 0.618 

0 

0 

0 

0.236 

i).764 

-1.528 

-0.764 

-0.764 

2.472 

0 

3.708 

-1.236 

1 

-2.764 

14.472 

-1.056 

7.236 

0.19 

1 

-0.07 

0.50 

A,4=-1.618 

0 

0 

0 

-4.236 

5.236 

-10.472 

-5.236 

-5.236 

-6.472 

0 

-9.708 

3.236 

-6 

16 

-4 

9 

-7.236 

5.528 

-18.944 

2.764 

-0.38 

0.29 

1 

0.15 


17 * 
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Columns II, III and IV are the coordinates of the fourth column 
of the matrices Bi multiplied by the corresponding powers of 


and column I includes the coordinates of the vector 


• Column V 


contains the coordinates of the vectors x(0 and column VI contains 
their coordinates after normalization. ^ 


6.7. Danilevsky’s Method 

Two matrices A and B are said to be similar if one of them can 
be obtained from the other by means of a transformation with the 
use of a nonsingular matrix, i.o. if the equality 

B -= S-^AS 


is satisfied. If a matrix S is similar to a matrix A, then we 
write B A. 

In Danilevsky's method the construction of the scheme for 
computation is based on the principal property of similar matrices: 
similar matrices have similar characteristic polynomials. 

If we use similitude transformations to reduce the matrix 


^11 

®12 

ai3 . 

• • ^\n 

^21 

®22 

®23 • 

. . a^n 

®3l 

®32 

^33 • 


_®ni 

®n2 

^713 • 

• • ®nn_ 


to the so-called Frobenius form 



r/ii 

/l2 /l3 • 

• /i, n-i 

fin 


1 

0 

0 . 

. 0 

0 

F = 

0 

1 

0 . 

. 0 

0 


0 

0 

0 .. 

. 1 

0 


and then expand the determinant 


det (F — U) = 


/li — ^ 

/l2 

/13 • • 

• h. 

n-1 fin 

1 

-x 

0 . . 

. 0 

0 

0 

1 

-X .. 

0 

0 

0 

0 

0 . . 

. 1 

-X 


( 1 ) 


( 2 ) 


( 3 ) 


according to the elements of the first row, we obtain 


D {X) = det (F - XI) = (/n - X) {-X)^-^ - f,, 

- + /i3 - . . . + 
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or 


D (\) = det (F - %!) - (-1)^ 

-^3X^-3 _ . . . pj. (4) 

Here = /n, = /lai Pn = /i 3 » • • •» Pn = /m the coeffi- 

cients of the characteristic polynomial of the matrix F, which, by 
virtue of the similarity of the matrices F and A , are also the co- 
efficients of the characteristic polynomial of the matrix A. 

In accordance with Danilevsky’s method, the matrix A can be 
turned into the Frobenius matrix F similar to it with the help 
of w — 1 similitude transformations which successively transform 
the rows of the matrix A , beginning with the last row, into the 
corresponding rows of the matrix F. 

The scheme for transformation of the matrix A into a Frobenius 
matrix F similar to it. Suppose we have to transform the row 
« 7 ii ^ 7 j 2 • ■ M . 77 - 1 ^ 7 ] 77 ^1^1^ row 0 0 ... 1 0. Assuming that 
an,n-i ^ divide all the elements of the (n — l)th column 

oT the matrix A by a„, „..j. Then its nth row assumes the form 

^711^712 ••• ~ ^ ^nm ••• 1 ^n7j- 

“Til n-l 

2°. We subtract the (n — l)th column of the transformed matrix, 
multiplied by the numbers a„ 2 » • • ^nn respectively, from 
all the other columns. For the nth row we obtain 

fl/il 1^77 2 “ ^ 77 ? • • • ^^77 77 ®n 77 * 0 0 . . . 1 0. 

3®. We take the matrix obtained from the identity matrix 

as a result of the same transformations, as a nonsingular matrix: 

"1 0 ... 0 I) ““ 

0 1 ... 0 0 

Af = » 

^ ^ 1 2 • • ^71— 1» 77-1 n 

_ 0 0 . . 0 1 


where 


I i 


77-1 


(5) 


The operations performed are equivalent to the postmultiplication 
of tlu! matrix -i by the matrix A: 


B=-AMn-i--= 



ai2 

• • ^1, 77-1 

^171 

^21 

^22 

• ^2f n-l 

flori 

®77-] 

If 1 «n-i. 2 • 

• • 71-1 

“tI-Ii 71 

J' 

0 

.. 1 

0 
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r ^ 

0 

.. 0 

0 



0 

1 

.. 0 

0 


X 


1 2 

. . ^n—i . n- 

-1 ^n-l. 

71 


0 

0 

. . 0 

1 



fbii 

b^, .. 

• ^ii n-i 

bin ■ 




^22 

• • ^ 2 » n-i 

^271 



bn-i. 

1 ^n-1. 2 • ‘ 

• • n-i 

&n-i. 71 



_ 0 

0 

.. 1 

0 



The elements of the matrix B can be found from the formulas 

^ij ^i» 71 -1^71 -If jy ~ n -I 72-1* (^) 

However, the matrix B = we have constructed is not 

similar to the matrix A . 

4®. To obtain a transformation of similitude, we must premul- 
tiply the inverse matrix M^Li by the matrix B: 

^nLiAM 


The inverse matrix M^li has the form 

ri 0 ... 0 

0 1 ... 0 




0 

0 


®ni ®n2 • • • ®n» n-i ®nn 
0 0 ... 0 1 


We set MnliAMyi^i = C, and, consequently, C =- Mn'.^B, The 
premultiplication of the matrix by the matrix B does not 

alter the trafnsformed row of the latter and the matrix C has the 
form 



ri 

0 

.. 0 

0 "I 


0 

1 

.. 0 

0 

II 

1! 

am 

an 2 • 

• • ^n* n-\ 

^71 71 

1 

_0 

0 . 

0 

1 


ri>ii 

^12 

^1, n-1 

bin 


^21 

622 

• • ^ 2 t 71-1 

^2n 


^ 71 - 1 , 1 

^n-if 2 • 

• • ^ 71 - 1 . n-1 

bn-i. 

n 

J) 

0 

.. 1 

0 

- 

r ci\ 

Cj2 

^li n-1 ^in 


^21 

^22 

^2i n-1 ^2n 


1 ^Tl-li 1 ^ 71 - 1 , 2 • • 

• ^n-ii n-1 ^7i-li 71 


Lf’ 

0 

. 1 0 

J 
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Indeed, multiplying the matrix Mn-\ by B, we only change the 
{n — l)th row of the matrix B since Cfj = bij for all the other 
rows. The elements of this row can be found from the formulas 


n 

^n-ii /= 2 n). 

ft=l 


(7) 


Tho matrix C obtained is similar to the matrix A and has one re- 
duced row. 

5®. Furthermore, if 0, we perform similar opera- 

tions for tho matrix C, taking the {n — 2)th row as the principal 
row. Then, using the intermediate matrix Z)= we get 

a matrix I — = Mnl^ CAfn -2 with two reduced rows. We 

perform the same operations for the matrix / and so on until we 
obtain a Frobenius matrix. 

All these transformations are written as a computational scheme. 
The following example shows how it is formed. 

Example 1 . Use Danilevsky’s method to expand the characteris- 
tic determinant of the matrix 


"-4 —3 1 

2 0 4 -^-1 

11 2-2 
- 1 1-1 -U 


A ist stage. Wo reduce the matrix A to the Frobenius form and 
compile a table to make calculations (see Table 6.6). 

(1) We put the elements a// (i, / = 1, 2, 3, 4) of the matrix A 

4 

into rows 1-4 of the table and the control .sums ^ aij = 

.=1 

(i = 1, 2, 3, 4) into tho column 2. Then we mark the element 
043 == — 1 which is in the third column (marked column). 

(2) We write the elements of the third row of the matrix Mj^ 
yifg, found from formulas (5), in row 1: 




^43 



^ 32 — 




= 1 . 


= -l. 


<>44 — ^ 

®4S — 1 


^35 " 


fil 

®43 


0 


= 0. 


The number 0 must coincide with the sum of the elements of 
row I after substituting —1 for the value of the element m 33 obtai- 
ned, but in this example m 33 = —1. (For the sake of convenience 
the number —1 is usually written beside the element and 
is separated from it by a line.) 

(3) We write the third row of the matrix which must coin- 
cide with tho fourth row of the original matrix A , in row^s 5-8 and 
the column for A/"^. 
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Table 6.6 


Rows 

M-l 

Colinniis 

2 

S' 

1 

2 

3 

4 

1 


-4 

-3 

1 

1 

-5 


2 


2 

0 

4 

-1 

5 


3 


1 

1 

2 

-2 

2 


4 


1 

1 

R-| 

-1 

0 










I 


1 

1 

-1 

-1 

0 



Mr 







5 

1 

-3 

-2 

-1 

0 

-6 

-5 

6 

1 

() 

4 

-4 

-5 

1 

5 

7 

-1 

3 

3 

-2 

-4 

0 

2 

8 

-1 

0 

0 

1 

0 

1 

1 

0 

7 ' 


0 

l-M 

-4 

-1 

-6 










II 


0 

-1 

-4 

-1 

-6 



Mr 







9 

a 

-3 

1 

2 

7 

2 

8 

6 

10 

-1 

6 

-4 

-20 

-9 

-27 

-23 

11 

-4 

0 

1 

0 

0 

1 

0 

12 

-1 

0 

0 

1 

0 

1 

0 

10 ' 


|-6| 

0 

19 

9 

22 



V M, 







III 

X. 

0.167-1 

0 

3.167 

1.500 

3.607 



7 ifr ‘ Xs, 







13 

-6 

0.500 : 

2.000 

-2.500 

-2.500 

-2.50») 

-3 

14 

0 

1 

0 

0 

0 

1 

0 

15 

19 

0 

1 

0 

0 

1 

0 

16 

9 

0 

0 

1 

0 

1 

0 

13 ' 


-3 

7 

24 

15 

43 
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(4) Then we write the elements of the matrix R A ^ M^. 
found from formulas (6) for the unmarked columns, in rows 5 8 
and the appropriate columns. 

The first column is 



- 

= «ll + 

<*13***31 ~ 

— 4 - 

1- 1 ■ 1 = ■ 

— 

3, 


- 

= «21 + 

<*23***31 ” 

2 1-4 

•1 = 6, 




^31 ~ 

■ <*31 + 

<*33***31 ~ 

1 1- 2 

•1 = 




= 

<*41 “1 

<*43'**31 ~ 

1 (- 

- 1)-1 = 

0 . 


The 

second column is 







*13 

= «1'2 -1 

<*13*** 32 

— 3 

1 1.1 -- 

— 

2 


h, - 

- <*22 "1 

■ <*« )'** 32 " 

-0 1- 

4.1 - 




ft ;j 2 

~ ^32 ! 

<*.3.3*** 32 

- 1 f 

2 . 1 3, 




*43 

" "42 1 

<*13***32 ~ 

- 1 1- 

( - l).l 

- 

0 . 

Th(‘ 

fourth column is 







l>U - 

"11 “r 1 

^*1.3<'*.34 -■ 

1 + 1. 

( -1) -- 

0 , 



^24 ■ ' 

"24 -|- 

<*2 3*** 34 

- - 1 -1 

4.(- 1) 

- 

■ - 


^34 

' I 

<*3.3*** 34 

2 

- 2 .(- 1) 

-- 

^ - 


ft4 4 --- 

"44 -1 

<*1.3*** .31 = 

- • 1 : 

(- '!)•( 

— 

1) 


The transformed elements of the third (marked) column are ob- 
tained by multiplying the initial elements by ~ - - 1. 

The third column is 


*13 “ 

“ <*13*** 33 ’■ 

^ !■ 

(- 1) 

= -1, 

'2.3 “ 

= ^2.3*** .33 

- 4. 

■ (-1) 

- -4, 

'.33 ” 

~ <*33*** 33 " 

- 2< 

• (-1) 

— 9 

“1 

1.3 

' <*13*** 33 " 

(- 


-1) = 1 


The last row of the malrix B must have the form 0 0 1 0 

To verify the calculations, we add to the matrix B the corre- 
sponding elements of the column for transformed with the use ol 
the analcjgous binomial formulas for 0; 

^6 «15 + ^=—5+1.0=-^ —5, 

ft., a = ^.,6 -h «2;,^3r, ~ f) -f- 4-0 — 5, 

^^10 I- 35 -- 2 I- 2-0 - 2, 

= ^45 - I ' « 43"^•^5 0 I- (— l )-0 = 0 . 

We write tlie results obtained in the column for in the approp- 
riate rows. Adding to the elements of the column for V, the corre- 
sponding elements of the third (marked) column, we get the control 
sums for rows 5-8 (i = 1, 2, 3, 4). i 

The column ^ 

^IB = + rti3 == — • 5 — 1 — 6, ftaB = ^26 + «23 = 5 — 4 = 1, 

^3B ~ ^30 ^33 “2 2=0, ft45 = ft4^ ^43 = 0 -}- 1 = 1 . 



266 


Computational Mathematics 


In addition, for the sake of verification, the elements of the 

4 

column 2 ®^re calculated with the use of the formula bib = 2 


= 1, 2, 

3, 4): 











bib 

= 611 ■ 

+ 

bi . 

+ *’13 

+ 6,4 = 

- 3 ■ 

- 

2 

— 

1 4- 0 

= -6, 

bib 

= frji 

+ 

^22 

+ *’23 

+ bu = 

6 + 

4 

— 

4 

- 5 

1, 

bsb 

~ &31 

+ 

^32 

"1" **33 

+ *’34 = 

3 + 

3 

— 

2 

— 4 = 

0, 

bib 

= &41 

+ 

642 

1 + *’4J 

1 + **44 = 

0 + 

0 

4- 

1 

4 - 0 - 

^ 1. 


The matrix B of the form 


-_3 „_2 -1 0 - 
6 4 -4 -5 

^ ~ 3 3 2 —4 

-.0 0 1 o _ 

(5) The transformation M 3 ' which is performed on the mat- 
rix B and which yields a matrix C = alters only the 

third row of the matrix 5, i.e. the seventh row of the table. The 
elements of this transformed row 7' constitute the sums of paired 
products of the elements of the column for which aro'in rows 
5 - 8 , hy the corresponding elements of each of the columns of the 
matrix B [see formula (7)]: 

^31 = l-(-3) + 1-6 (-1).3 + (-l).O = 0, 

C 3 , = l.(-2) + 1.4 + (-1).3 + (- 1).0 = -1, 

C 33 == 1- (-4) + (-l).(-2)-|-(-l).l = -4, 

C 3 , = 1.0 f l-(-5) + (-l)-(--4) + (-l).O --- -1. 

We transform the column for 2 in the same way: 

C 35 = !•(- G) + 1-1 + (-l)- 0 + (-l).l - 6 . 

As a result we get a matrix C consisting of rows 5, 0, 7', 8 with 
the control sums in the column for 2 * 



The matrix C is similar to the matrix A and has one reduced row. 
This completes the construction of the first similitude transforma- 
tion: C = 

2nd stage. Assuming the matrix C to be the original one, we 
separate the element = — 1 (the second column) and continue 
the process by analogy. 
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^23 




We find the elements of 

the matrix 

Afyj _2 

from 

(5): 








^31 

0 

— 0 

m — 

1 

1 

^ i 


^32 

—1 ■ 


^22 — 

^32 

“ -1 

— — if 


^83 

-4 


• A. m . 


^34 

-1 


^82 

-1 ■ 


4, ^24 


^32 

" -1 “ 


^3B _ . 

-6 


■6. 





^32 

— 1 ' 







1. 


We sum upO — 1 — 4 — 1 = — 6 (m 22 = — 1, if ^22 were not 
equal to —1, then we should have replaced 771^2 by —1). 

(2) Then we write the second row of the matrix M'i}, which 
coincides with the third row of the matrix 6’, in rows 9-12 and the 
column for M-^ (sec Table 6.0). We find the elements of the mat- 
rix D = C'Afg. 

The first column is 


c/jj = _ 3 + (- 2)-0 = - 3, ^21 = 6 -t- 4.0 = 6, 

*^^31 = 0 + 0 = 0. 

The second (marked) column results from the multiplication of 
the corresponding elements of the matrix C by m 22 — —1: 


di2 ~ 

^^12^22 

- (-2).(- 1) = 2, 

<^22 

= 

^22^22 — 

: 4.(- 

^32 = 

^32^^22 

= (-l)-(- 1) = 1 





The 

third column is 






di3 ~ 

^13 ^12^23 ■■ 

1 + 

(- 

-2). (-4) 

= 7, 


^23 = 

' ^23 ^22^^23 ~ 

4 -1- 

4. 

(-4) = 

- 20, 


dfiw ~ 

^33 1 ^32^^23 “ 

4 -1- 

(- 

-1). (-4 

) = 0. 


The fourth column is 

di4 = Cj4 4“ ^12^^24 — 0*1 4" ( 2)* ( 1) = 2, 

^24 =" <^24 + =—54-4- (— 1) —9, 

^34 — ^^34 4" ^^32^24 ~ ^ 14" ( 1)*( 1) ~ 0- 

The column for 2' is 

^^16 = <^16 + ^ 12^*26 =- 6 4 - (— 2 ) -(— 6 ) =- 0 , 

^26 — ^25 H" ^22^35 =14- 4»(— 6) = —23, 

^36 = ^*86 4 - <^ 32^26 =- 6 4 " (~ l )-( — 6 ) = 0 . 

The elements of the column for 2 result from the addition of the 
elements of the column for 2^ f'® 1-^® corresponding elements of 
the marked column: 

dit = ^fie 4- di2 = (5 + 2 = 8, ^25 = ^^26 4" = -23-4=-27, 

d^h = dj® 4- dj, = 0 4" 1 = 1. 
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The matrix D has the form 

' — 3 2 7 2“ 

6 ~4 —20 —9 
0 1 0 0 - 

. 0 0 1 0 

The transformation which was performed on the matrix D 
and which yields I = alters only the second row of the 

matrix D, i.o. the tenth row of the table. The elements of this 
transformed row 10' are the sums of the paired products of the 
elei! ents of the column for T/t* which are in rows 9-12: 

- o.(- 3) -I (-!).(; H- (— i).o t- (-I)-O = - n, 

C22 -- 0.2 + (-4).l + (-l).O - 0, 

^2.. 0-7 + (-!)•(- 20) -I- (-/O-O -I (-l).l 19, 

e.j - 0.2 + (-l).(- 9) + 0 4).0 -1- ( -l).0 - 9, 

.,5 - 0.8 I- (-l).(- 27) I- (-4).l -1- (-l).l - 22, 

Segj. ^ - 6 + 0 + 19 + 9 22. 

This completes the construction of the second transformation of 
similitude: / = The matrix / ^ C has two reduced rows: 


— 3 2 7 2 


0 19 9 


1 0 0 
0 10 


0 

0 


3/ i atat^p. Wo assume the matrix / to be tlio orii^inal one*. W(' 
separate tin* element Cgi ' i*> (fh(i first column) in it and trans- 
form the matrix / into a similar Frohenius matrix F. Conlinuin^^ 
the process by analogy, we find, from formulas (5), the elements 
of the matrix M^: 


mil 


1 

^^21 


mi 3 — 

mi5 =- 


^23 

^21 

1 . 25 . 

^21 


1 

— 6 ~ 
19 
” -G 
22 
-G 


— 0.1G7, m,2^ 

— 3.1G7, mil - 
= 3.6G7. 




0, 


9 


-1.500, 


To obtain the sum ^ = 3.GG7, we replace m-i, - — 0.1G7 by — 1: 

2 = — 1 + 0 + 3.167 1- 1.500 = 3.G67. 

We write the Frohenius matrix F in rows 13-lG. We first con- 
struct G = I Ml and then F ~ M^^G. In the column /l/7^ wo write 
row 10' of the matrix / (see Table G.6). 




Cli. 0. The Eigenvalues and Eigenvectors of a Matrix 269 


The lirst (marked) column is 

i'll ="-= ‘Ti"iii ■ ■ ( - 3)-(- 0.167) -- 0.500, 

(?2i = == (- 6)-(- 0.167) = 1.000. 

The second column is 

eii = ei2 + Sum, 2 - 2 1- (— 3)-0 2.000, 

gaa = c. 22 + e2i"ti2 "= 0 I- ( -6).0 ^ 0. 

The third column is 

^13 = «i3 + ^ ' |- (— 3)-3.167 - —2. .500, 
fc'23 ^ «23 I' ‘'2i"‘i3 “ 19 + (—6) .3. 167 -- 0. 

The [ourlh column is 

^rl4 = -f «n™i4 -■= 3 1- (—3)- 1.500 ' ^ —2. .500, 
ff24 ~ «24 + «21™14 ~ 0 + (—0)- 1.500 — 0. 

The column [or 2' is 

Si6 = -\e. t- «a«45 = 3 -! (-3). 3.667 = -3. 

Sta ■= e.25 + ejiWio = 22 -j- (—6) -3.667 = 0. 

The column for ‘s 

Sii = gn i- = - 3 + 0.500 = -2.500 
gia = gn + gii H- ffi3 + ^r,^ = 0.500 f 2.000 -2.500 
- 2.500 = - 2.500, 
git = ff23 + ^21 = 0 -h f = 1. 

gii = ffal + ^22 + ff2S + ^24 ~ 1 + 0 + 0 + 0 = 1. 

The elements of the transformed row 13' are the sui' of the 
paired products of the column for , 1 / 7 ^ which arc in row 13-16; 

hi ^ (-6)-0.500 -f 0-1 f 19-0 -h 9-0 = -3, 

/i3 (-6)-2.000 -t- 0-0 -I- 19-1 + 9-0 = 7, 

/i3 ^ (— 6)-(-2.500) 4- 0-0 + 19-0 -f 9- 1 = 24, 

/j^ = (-6)-(-2.500) -f- 0-0-f 19-0 -h 9-0 = 15, 

V = ( -6)-(-2.500)+0-1-1-19-1+9-1 = 43, 

2 - — 3 + 7 -I- 24 15 = 43. 

Thus the required Frobenius matri.x F, similar to A , has the form 

—3 7 24 15 ' 

10 0 0 
0 10 0 • 

. 0010. 
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We seek the characteristic determinant of the matrix F: 


D (X) = det (A ~ XI) = det (F - XI) = 


— 3-X 7 

1 -X 

0 1 

0 0 


24 15 

0 0 
-X 0 
1 -X 


From this, expanding the determinant Z^(X) according to the 
elements of the first row, we obtain 


D{X) = 


-3-X 7 24 15 

1 —X 0 0 

0 1 0 
0 0 1 X 


= (-3-X) 


— X 0 0 

1 -X 0 
0 1 -X 



1 

0 

0 


1 

-X 

0 


1 

-X 

0 

7 

0 

— X 

0 

+ 24 

0 

1 

0| 

-15 

0 

1 

-X 


0 

1 

-X 


0 

0 

-X 


1) 

0 

1 


= (--3-X(-X3)-7X2 + 24(-X)-15 
= X^ + 3X3 - 7X2 - 24X - 15. A 


Particular cases in Danilevsky’s method. This method can be 
used without any complications if all the separated elements are 
nonzero (as in the example just considered). Now if as a result of 
the transformation of the matrix A = [an] {i = i, 2, . . n, 
/ = 1, 2, . . n) into the Frobenius matrix F, we get a matrix of 
the form 



dll 

di2 . 

• dll . 

• • di, k-i 

dik . 

.. di. 

n-l 

dm 




■ dti . 

• • d2, fe-i 

d2h • 

•• dt. 

n-i 

din 


dll 

di2 . 

• • 

• • di, h-i 

dih • 

.. d,. 

71-1 

din 

D = 

dki 

dh2 • 

. dhi . 

• • dh, ft-i 

dhh • 

.. dft. 

n-l 

dhn 


0 

0 . 

. 0 . 

.. 0 

1 

.. 0 


{) 


_0 

0 . 

. 0 . 

.. 0 

0 

.. 1 

• 

e • 

0 


and find that = 0, then we cannot continue with the trans* 

formations using Danilevsky’s method. Two cases are possible here. 

1st case. Assume that an element of the matrix D, which lies to 
the left cd the zero element dh, k-if Is nonzero, say dhi 0, where 
Ick — 1 , Then we replace the zero element dk, k-i by it, i.e. in- 
terchange the fk — l)th and 1th columns of the matrix D and simulta- 
neously intercnange its (k — l)th and Ith rows. Thb new matrix is 
similar to the given one and we can continue with the calculations 
using Danilevsky’s method. 
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2nd case. Assume that = 0 (^ = 1, 2, . . A: — 1), i.e. that 
the separated element and all the elements of the matrix which are 
to the left of the separated one are zero. Then the matrix D has 
the form 



dll 

di2 

... di, 

dik 

• • ■ di, 

di n 

^21 

^22 

• • • ^2, k-l 


• ■ • ^2, 71-1 

^271 


1 d^-1. 2 

• • • dh-l» h-l 

dh-\, h 

... 7i_ 1 

dfi-i, n 

0 

(1 

. . . n 

dhh 

• • • d/i, 71^1 

dhn 

0 

0 

... n 

1 

. . . n 

0 

0 

0 

... 0 

0 

... 1 

0 




We divide the matrix D into four cells so that one matrix is 
zv‘ro. Then the characteristic determinant det (D — kl) breaks 
into two dpterminants: 

det {D — KI) = det {D^ — U)-det {D^ — kl). 

but the matrix has now the form of the Frobenius matrix and 
therefore it remains to reduce the matrix to this form. 

Table 6.7 


l^ows 

Ml 

Columns 

2 

X ' 

1 

2 

3 

4 





1 


3 

-2 

1 

-1 

. 1 


2 


3 

-2 

1 

1 

3 


3 


5 

-4 

2 

0 

3 


4 


-1 

-1 

S 

1 

0 










I 


1 

1 

11 -1 

1 

0 


5 

-1 ' 

4 

-1 

1 

-2 

2 

1 

6 

-1 

4 

-1 

1 

0 

4 

3 

7 

1 

7 

-2 



5 

3 

8 

1 

0 

0 



1 

0 

7 ' 


-1 

0 

Bl 

0 

0 
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Example 2. Use Danilevsky’s method to expand the characteris- 
tic determinant of the matrix 

" 3—2 1 —1 ' 

3-2 1 1 

5 -4 2 0 • 

--1 -1 1 1 ^_ 

A We tabulate the calculations (see Table G.7). The separated 
element Cgg = 0; wo cannot continue the calculations using Daiii- 

Tahlc 6.8 


Rows 

M-1 

Columns 


S' 

1 

2 

3 

4 

2 




5 

1 -1 

-1 

4 

1 

0 

4 


6 

-1 

-1 

4 

1 

-2 

2 


7' 

1 

0 

1 1 

1 

0 

0 


8 

1 

0 

1 1 

0 

1 

0 

1 










II 


0 

-1 

1 

0 

0 


9 

0 

-1 

-4 



0 

4 

10 

-1 

-1 

-4 



-2 

2 

11 

1 

0 

1 

0 


1 

0 

12 

0 

0 

0 

1 

0 

1 

0 

10' 


0 

1 

5 

-5 

2 

3 










III 



-5 

1 

5 

-2 

-3 


13 

1 


1 



0 

3 

14 

5 


0 


0 1 

1 ’ 

0 

15 

-5 


1 


0 

1 

0 

16 

2 


0 


0 

1 

0 

13' 


4 

-4 

2 


4 
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levsky’s method. Since roi 0, we interchange the second and the 
first column, the first and the second row of the matrix C and con- 
tinue with the calculations (see Table 6.8). 

As a result we obtain a Frobenius matrix F ^ A\ 


"4 -4 2 2" 

1 0 0 0 

(i 10 0 ’ 

J) 0 1 0 _ 


whence wc find that 

D (X) = dot {A — Xr) = det {F — XI) - X^ — 4^^ 

+ 4>.2 _ 2X + 2. 4 

Example 3. Use Danilevsky’s method to expand the character- 
istic determinant of the matrix 

-0 13 2-1 
14 5 0 
1121 • 

1111 


A VVe tabulate the results of the calculations (see Table 6.9). 
Since the separated element is equal to zero, we cannot continue 
the calculations using Danilovsky’s scheme. 

The matrix D on c has the form 


" 1 

0.5 - 

-2.5 

2.5 

0 

6 

4 

— 7 

0 

1 

0 

0 

_0 

0 

1 

0 


We partition the matrix D into four cells by bordering and 
compute D (X)\ 


D(X) -det(i:>--X/) - 


\~X 

0.5 

— 2.5 

2.5 

0 

<< 

1 

CD 

4 

— 7 

0 

1 

-X 

0 

0 

0 

1 

-X 




iS — X 4 —7 
1 —X 0 
1 1 —X 


^(1 \)[(6->t) A.2 + 4X-71 


^-~~-^X^ — lX^-\-2X^-\-\\X~l. A 


IS-OlO/i 
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Table 6.9 


Rows 

■ 



1 

1 

2 

3 

n 


1 


■IB 

1 


0 

1 

3 

2 

6 


2 


1 

4 

5 

0 

10 


‘i 


1 

1 

2 

1 

5 


4 


1 

1 

m 

1 

4 



BUgi 







I 


-1 

-1 

1 -1 

-1 

-4 


5 

■■H 

-3 

_2 

3 

-1 

-3 

-6 

6 


-4 

-1 

5 

-5 

-5 

-10 

7 


-1 

-1 

2 

-1 

-1 

-3 

8 

HB 


0 

1 

1 

0 

1 

0 

7 ' 


-8 


11 

-7 

-8 










II 




2.75 

- 1.75 

-2 


9 




— 2.5 

2.5 

1.5 

1 

10 


-2 


2.25 

- 3.25 

- 2.75 

-3 

11 


0 


0 

0 

1 

0 

12 

mn 

0 


1 

0 

1 

0 

10 ' 


0 

6 

4 

-7 

3 



6.8. Using Danilevsky’s Method for Calculation 
of Eigenvectors 

Let^ y = (i/i, ^21 • • •> i/n) eigenvector oi the 

Frobenius matrix F corresponding to the given value of 
A,. Then Fy = Xy, whence we have {F — XI) y = 0, 
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1 

L. 

fl2 

/l3 

• • fin 


r 1/1 “1 

1 

0 

— X 

1 - 

0 

X 

... —0 

0 

. 

1/2 

0 

n 

n 

... -X 


- Vn - 


(1) 


Carrying out multiplication, wo got a system for deter- 
mining tlio coordinates y^, . . yn the eigenvec- 
tor y: 


if 11 — + 712^2 + /l3i/3+ • • • 4~ /l7li/7l = ^1 

yi~Xy2 

i/2 — >-^3 =^^ (!') 


I i/n-i— >-i/n'-=^- 

This system of linear equations is homogeneous. We can 
find its solutions to within the proportionality factor in the 
following way. We set == 1 and then successively 
find that 

1/n-l — Un-I — ~ • • • » l/i ~ ^ 


Thus the required eigenvector is 


I 


1 


( 2 ) 


Since the matrix F is similar to Jt is also an eigenvalue 
of the matrix A. 

We designate the eigenvector of the matrix A, corre- 
sponding to the value ^ as a; = {x^, x.,, . . x^)- Then we 

obtain 

X = _iiV/ ^ _2. . (3) 

where ^n- 2 » • • •» identity matrices trans- 

formed by Danilevsky’s method. 

ift* 
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F'or instance, the transformation carried out on y, 
yields 



1 ^12 • • 

• rriinl 


Vl 


“ 71 

S ^ihyu 


0 1 

0 

• 

H 2 


k=i 

2/2 


J) 0 . . 

. 1 


l/n _ 


^ yn ^ 


“■71 “ 

k=\ 

1 

Consequently, the Iransformation cliaiiges only the 
first coordinate of the vector y. Similarly, the Iransforma- 
tion changes only the second coordinate of the vector 
etc. Repeating this process n — \ times, we get the 
required eigenvector x of (he matrix A, 

Example. It was shown in Example 1 of (3.7 that Danilevsky’s 
method could bo used to reduce the matrix 


r ~4 — 3 1 1-1 

2 0 4 —1 

112-2 
1 1 -1 — 1 _ 

to the Frobenius form 


— 3 7 24 15- 
1 0 0 0 

0 1 n 0 • 

_ (I (t 1 ()_ 

Calculate the eigenvector x(^) = - (xj, 2 * 3 , 0 : 4 ) if A,] = — 1. 
A We use formula (3), i.e. x — y, where 


r A,3n 


r 



1 

k 


—1 

_1 
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and take the matrices M from Table fi.fi. We find in 
succession that 



Wg can find by analogy the eigenvectors for the values of ^ 3 » ^4 
as well. ^ 

6.9. Using Iterative Methods to Find 
the First Eigenvalue of a Matrix 

Iterative methods can he used to find the first (i.e. the 
greatest in absolute value) eigenvalue of the matrix A 
without evaluating the characteristic determinant. 
Assume that 

del {A ^Xl) --^0 (1) 

is a characteristic equation, X^, . . X^ its roots 
which are tlie eigenvalues of the matrix A = [«,;! (where 
/ = 1, 2, . . n, / = 1, 2, . . n). We assin* ^ that 

I 1 ^ I ^2 I ^ 1 ^3 I ^ ... ^ 1 ^71 I » 

i.e. Xi is an eigenvalue greatest in absolute value. 

Then, to find the approximate value of the root Xi, we 
use the following scheme: 

(1) we arbitrarily choose the initial vector y, 

(2) set up the successive iterations: 

y(0 r /ly, 

y(2) = A- Ay ^ A2y, 

y(3>-- A- A^y^ A^y, 

A- A^'^y^ A<^^y, 
y<^+i) = A • 
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(3) choose the last two values of the sequence = 
and and then 


= lim 

m-*oo 


V 


, or 


y(m+i) 


j/r 


( 2 ) 


where and are the respective coordinates of 

the vectors yl”*'*'*) and (i = 1, 2, . . n). 

Thus, taking a sufficiently large number of iteration m, 
we can calculate the root 3li, greatest in absolute value, 
of the characteristic equation of the matrix, with any 
degree of accuracy. To find this root, we can use any coor- 
dinate of the vector y<^>, in particular, the arithmetic 
mean of the respective ratios for different coordinates. 

If the choice of the initial vector y is poor, formula (2) 
may not yield a needed root or even lose sense, i.e. the 
limit of the ratio may not exist. It is easy 

to detect the latter case from the “jumping” values of the 
ratio. If this occurs, the initial vector must be changed. 
The vector y(^+i) can be taken as the first eigenvector. 

Example. Find the first eigenvalue of the matrix 

[ 3 1 0 
1 2 2 
0 1 1 

(with three decimal digits) and the corresponding eigenvector. 

A (1) We choose the initial vector y= 1 

Ll 

(2) We set up m = 10 iterations: 

y(l) = i4y, y(*)= i42y(l), ^ y(10) = yllOy. 

We tabulate the results of the calculations (see Table 6.10). 


Table 6,10 


y 

Ay 

A2y 





B 


A»y 

AH'y 

1 

4 

M 

69 

274 


4189 

16260 

62 973 

243569 

941 37( 

1 

5 

18 

67 

253 

964 

3693 

24193 


210 663 

812 581 

1 

2 

17 

25 

92 

345 

1309 


19 195 

73 845 

284501 
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(3) Terminating the iterations with yO*’)— we have, fer 

difiercnt coordinates, 




y(iO) 


941 370 




243 569 
812 585 


= 3.865, 




210 663 
284 508 


= 3.857, 
3.853. 


• 73 845 

(4) Wo calculate Xi, as the arithmetic mean of and 


Xi — 


XJ* > + X52) + V4") 3.865 + 3.857 + 3.853 


3 3 

(5) We can take the vector y(io) = ilioy = 


= 3.858. 


"941 370' 

812 585 as the 
_284 508. 

first eigenvector of the matrix A. Normalizing it, i.e. dividing 
all of it? <'** "dinates by the norm of the vector equal to 

II y(io) ||g= Z 941 37< )2 + 81 2 5852 + 284 5< )8=^ = 1 .28 • li )« , 

wo got the first eigenvector of the matrix A corresponding to the 
first eigenvalue Xi = 3.858: 


x(i) 


‘0.74" 
= 0.64 

_0.22_ 


6.10. Deleniiiniiig the Successive Eigenvalues and 
the Corresponding Eigenvectors 

Let the eigenvalues of the matrix ^1 be such .at 

\K\>\K\>\K\>--->\K\- ( 1 ) 

Tlien, to find we can employ Ihe so-callod 'k-differences, 
using llie value X, we have: 

Ax./l^y ^ ^’"y— 


or 


Ax.y<’") = y<”+h - X,y<’"), A^.j^"-*) = jK”) - X,y<'^‘), (2) 


whence, passing to the coordinates of the vectors, we find 
that 


1 




Vi 


(t -- 1, 2, . . n). (3) 
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Formula (3) yields rough values of Xo since the estimation 
of was also approximate. 

If the moduli of all the eigenvalues are different, then 
we can use formulas, similar to (3), to compute the other 
eigenvalues, but the successive results will be even less 
accurate. 

The number of the iteration m in the calculation of ^2 
should be smaller than in the calculation of to obviate 
the loss of accuracy when subtracting close numbers. 

Example* For tho matrix 
A 

find the second eigenvalue ^2 ^^d the corresponding eigenvector x(2). 
Carry out the calculations for m = 8 iterations with three decimal 
digits. 

A We use the table of values of A^y for m = 7, 8, 9 (see Ta- 
ble 6.10). 



A7y 

A8y 

A®y 

16 260 

62 973 

243 569 

14193 

54 650 

210 663 

5 002 

19195 

73 845 

. 




We employ formula (2) to set up X-differences: 

('= 1 . 2 . 3 ). 

For each row we take the appropriate value 01 Xj*. XJ*^ ^ 3.8G5, 
X<*>= 3.857, XJ®^ = 3.853. We get the following table. 


Table 6.11 


A8y 


AxiA’y 

A®y 

XiASy 

Axi^oy 

62 973 ^ 

62 845 

128 

243 569 

243 390 

179 

54 650 

1 54 742 

-92 

210 663 

210 785 

-122 

19 195 

19 272 

-77 

73 845 

73 958 

-113 
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(3) For each row we calculate X 2 using formula (3): 


v.)^AZLl_iZlL-i 4 oo -122 

^ ~ 128 ^ ^ -92 “ 

-113 .,.0 

(4) We determine Xo as the arithmetic mean of and 

, 1.400- 1 -1.32() + 1.468 , 

A.2 q - q I.-DOo. 


(5) As the second eigenvector we take 

179" 
— 122 
- 113_ 

Normal i-^i I g we have 




\(-) 


0.73" 
— 0.50 

-0.46 


We can find the third eigenvalue of the t;iven matrix knowing 
the trace of the matrix; since + ^2 + X3 — Tr A = 3 + 2 + 
1 = 6, it follows that L, ^ 6 — 3.858 - 1.398 = 0.744. 4 


Exercises 


1. Use the method of direct expansion to find the characteris- 
tic polynomials of the following matrices: 


(a) 




(c) 



2. Find the characteristic numbers and eigenvectors of the 
matrices 


T -3 
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ri 2 —41 


"2 —2 1 3' 

[3 -1 2 

Li 0 -1 

, (b) A = 

4 —1 —2 —3 

1 2—5 4 

-1 -1 2 -4- 


3. Use Krylov’s method to expand the characteristic determi- 
nants of the following matrices: 


(a) A = 


1 —2 1 — 2 ' 

2-1 2-1 
1 1 — 2—2 
L -2 —2 1 1 - 

4. Use Leverrier-Faddeev method to expand the characteristic 
determinants of the following matrices: 


(c) A = 


"5 

-4 

3 

0' 


"2 

-4 

3 

-2" 

2 

1 

— 2 

1 


1 

0 

— 5 

-3 

1 

1 

1 

— 1 

, (b) 

1 

1 

-2 

-2 

-2 

1 

-2 

0 _ 


-0 

1 

-1 

-1 


i(a) A = 


5. Employing the Leverrier-Faddeev method, find the inverse 
matrices for the matrices given in Exercise 4. 

6. Expand the characteristic determinant of the matrix 

r 2 -1 2 - 

A=\ 5-3 3 

L-1 0 -2, 

and use the Leverrier-Faddeev method to calculate the eigen- 
vector. 

7. Use the iterative method to calculate the first and the second 
eigenvalue of the matrix 

r4 1 O'] 



Chapter 7 

Interpolation and Extrapolation 


7.1. The Function and the Methods of Its 
Representation 

In practical problems it is often necessary to establish 
relationships between processes and phenomena and to 
describe them by mathematical means. 

Let us consider the relationships for which a certain 
quantity y, characterizing the process, depends on a set 
of unrelated quantities that every set 

{xi, X 2 , . . is associated with a single value of the 

quantity y. This unique correspondence between the 
quantity y and the set of independent variables x^, 
^2, . . ., Xn is known as a functional dependence and the 
variable y itself is a function of the variables X2, . . 
the formal notation being 

y ^ f (xj, X2» • • .» Xji)» 

Thus the expression y = + 3y^X2+^i^s is a func- 

tion of three variables. 

If the quantity y is a function of one independent vari- 
able X, then their relationship can be representer' as 

y = / W- 

For instance, the area 5 of a circle is a function of an 
independent variable, the radius i? of the circle, i.e. S = 
/ (i?); the specific form of this function is 5 = nR^. 
The volume of a figure is a function of three dimensions, 
i.e. V =/(x,, X2, X3), and the form of this function 
depends on the shape of the figure. 

Mathematical analysis gives three methods of represent- 
ing functional relations: (1) analytical, (2) graphical 
and (3) tabular. 

The analytical method is most con\ aient for represent- 
ing the functional dependence y = f (x) since it directly 
indicates actions and the sequence in which they must be 
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performed on the variable x to obtain the correspojiding 
value of y. 

Thus, for instance, malhematical means allow us to ob- 
tain the following analytical dependence of goods and 
valuables supplied on credit and the seasonal expenses in 
agriculture on the expenses on the livestock, i.e. 

y = 51.0203 + 0.1051) :r, 

where y constitutes the credit against the goods and x 
CO istitutes the expenses oji livestock. 

Here is another example of analytical dependence: in 
a uniformly accelerated motion, the patli traversed and 
the time spent are related as 

.9 = 4- 0.5 

The advantage of the analytical method is the possibili- 
ty of obtaining the values of y for any lixed argument x 
with any degree of accuracy. 

The drawbacks of this method are the necessity to carry 
out the whole sequence of computations and the lack of 
visuality. 

These drawbacks are obviated when we use the graph- 
ical method of representing the function y == / {x). 

The graph of the function y = f (x) is the set of points 
of the a:y-plane whose coordinates satisfy the equation 

y =-f (^)- . 

The tabular method of representing functions is widely 
used in engineering, physics, economy and natural 
sciences (and is often needed in experiments). 

Assume, for instance, that as a result of an experiment 
we have obtained the dependence of the ohmic resistance 
/i of a copper rod on the temperature f in the form 
of a table: 


R 

77.80 

79.75 

80 .80 

82.35 

83.90 

85.10 


1 25.0 

1 3 ^^-^ 1 

1 36 .(t 1 

1 40.0 

1 45.1 

1 56.0 


In this experiment the value of the olimic resistance of 
the copper rod varies with temperature and is a depen- 
dent variable. 
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The advantage of the tabular method of representing 
a function is that for every tabulated value of an indepen- 
dent variable wo can immediately iind, without any 
measuremenls and calculations, the corresponding value 
of the function. 

The drawback of this method is that we cannot define 
the function completely, i.e. there are always values of 
the independent variable wliich are not included in the 
table. 

7.2. Mathematical Tables 

There are functions often encountered in mathematics 
whose calculation, despite* the seeming simplicity, is 
very cumbersome. These functions are usually tabulated, 
i.e. represented as mathematical tables. 

Table*' ul fujU'l ions of oik* variable are especially widely 
us(‘d. These are tables of inverse nurnbi'rs, of squares and 
cubes of numbers, square and cubic roots, tables of loga- 
rithms, tables of trigonometric functions, tables of expo- 
nential function and of other elemc'ntary functions. Tables 
of functions of two and several variables are also formed. 
The table of products of two numbers is an example of 
a table of functions of two variables. 

The table is a collection of values of a function for 
tlie sequence of values of the arguments .z:o» ^'21 • • ^n- 

It must include a collection of values of the argument 
such that for any values of the argument different from 

obtain the value of the function 
with the necessary degree of accuracy. 

The principal characteristics of the tables are: (1) the 
names of the functions whose values they express, (2) the 
volume, (3) the step, (4) the number of symbols of tlie 
tabulated function, (5) the number of entries. 

The //arne of a junction whose numerical values are tabu 
laled is the analytical expression of that fund ion, say, 
sin X, log e^' etc. 

The volume 0 ] a table is delined by the initial and finite 
values of the argument. Thus, for ins^ uice, the volume of 
the table y = sin x envelopes the values of the argument 
from O'^O' to 90"". 

For almost all tabulated functions the values of the 
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Table 7.1 


Radians 

Degrees 

Radians 

Degrees 

Degrees 

Radians 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

0.20 

11.459 

0.70 

40.107 

20 

0.349^7 

21 

12.032 

71 

40.680 

21 

36652 

22 

12.605 

72 

41.253 

22 

38397 

23 

13.178 

73 

41.826 

23 

40143 

24 

13.751 

74 

42.399 

24 

41888 


Continued 


Degrees 

Radians 

Minutes 

Radians 

Minutes 

Radians 

(7) 

(8) 

(8) 

(10) 

(11) 

(12) 

70 

1 .22175 

20 

0.00582 

50 

0.01454 

71 

23918 

21 

00621 

51 

01484 

72 

25662 

22 

00640 

52 

01513 

73 

27409 

23 

00669 

53 

02542 

74 

29151 

24 

oom 

54 

01571 


argument ip the table form an arithmetic progression, 
whose common difference h is known as the step of the 
table. Thus, 

h = Xi — Xi^i = const (i = 1, 2, . . n). 

Then 

= Xo + (i == 0, 1, . . n). 

As an illustration, let us consider a fragment of the table 
of conversion of radians into degrees and degrees into 
radians (Table 7.1). 

In the first two columns of the table the radian measure 
is an independent variable and the degrees are its function. 
The same is true of the third and the fourth columns. The 
value h = 0.01 radian is taken here as the step of the 
table. 

Beginning with the fifth column the inverse of the given 
function is considered, where degrees (or minutes) are 
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taken as an independent variable and the corresponding 
radian measure is a function of the degrees (or minutes). 
The step of this part of the table is equal to one degree (in 
the fifth and the seventh column) and to one minute (in 
the ninth and the eleventh column). 

There are also reference tables which have a complicat- 
ed two-level step. Down the column we lay off the values 
of the argument with a relatively large step fe* : Xi = 
Xq + (i = 0, 1, . . . , n) and the corresponding 
values of the function yt = fi = f (xt). Across the table, 
in the first row, we put the values of the argument with 
a liner step h, usually equal to a tenth of the large step: 
h = O.l/i*. The second and the subsequent rows include 
the values of the function for an argument equal to the 
sum of the values xi which are in the row and the column 
whose intersection is the value of the function. Thus, 
Table 7.2 is a iragment of the table of cubic roots from 
which it is easy to determine the large step down the 
column, h* =1, and the fine step across, h = OA. 

The step of a table is usually expressed as a digit of 
some decimal place (less frequently as two or five digits 
of a certain decimal place). For instance, in the tables of 
squares, cubes, of square and cubic roots, in the tables of 
logarithms the large step h* — I, in the tables of natural 
logarithms and the tables of inverse numbers the large 
step h* is 0.1 (see Table 7.2). 

If we consider the table of sines (Table 7.3), the large 
step in it is one degree and the fine step is equal to six 
minutes. 

The next characteristic feature of a table is the number 
of symbols of the tabulated function since the values of the 
function y = f (x) for the tabulated values of the argu- 
ment in mathematical tables and the results of measure- 
ments in engineering tables are approximate values. Only 
valid digits of the numerical value of a function are 
entered in a table. This means that the error does not 
exceed five units of the first dropped decimal place. The 
values of the function for all values of x presented in the 
table are determined with tlie same absolute error. The 
accuracy with which the \ allies of the tunctioii are given 
in the table is the accuracy of the table. Sometimes the 
accuracy is different in different parts of the table. 



Table 7.2 



lO 

CD 

CD 

CD 

to 

to 


iO 

lO 



vf 
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CO 

CO 

CO 

CO 

CnI 

CM 

CM 

CM 

CM 

CM 
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CM 
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CM 

CM 

CM 
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CO 
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to 
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03 
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O. 

03 
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o 
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CO 


O: 

03 

03 

03 
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* 
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03 
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03 
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tH 
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(OJ 


(TJ 

00 



03 

CD 

CO 

<o 

CD 




CM 

CM 

CO 


03 

as 

03 

o 

o 


lO 

i'- 

to 


v*r 


Op 

LO 

<M 

o 

to 




CM 

CM 

CO 


03 

03 

o. 

o 

o 


00 

- 
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Ci 
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03 
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o 
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CJ 
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CO 
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oO 
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CD 

CD 

CD 

CD 
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In some cases, wlioii wo work willi tables wo must kjH)W 
the dil‘f(‘reiicos of llio iioigliboiiriii^ values of the function 
given in tlio table, i.o. — ///. Tiiese difforences are 

known as the first-order forward and backward differences 
and are sometimes writlcui in tin* column ol‘ Uie func- 
tion between its values which take part in lln* lorjnalion 
ol* tbe corresponding hnite difference!. Idn* diflVrcocc's are 
written iji the nnils of I he last decimal place wilhonl 
zeros in front of the signilicant digits, and without llie 
dc'cimal point. For instance, in the table 


X 

sm .r 

l.oun 

1 .001 

0.84147 r, 

0. 84201 


the linitv^ dn^oence O.OOOo'i 0.rS4201 --0.rS^jl47 is writ- 
ten between tlie corresponding vahn‘s of the function. 

The number of entries is the next cliaractc*rist ic, feature 
of a (able. It is cMjiiivalent lo the Tiiimlau* of arguments of 
the function. Thus the tables for functional dependences 
// -- / {x) aj*e tables with ojie c*ntry. 'Tables 7.1, 7.2 and 
7.3 given above are of this kind. 

'The* tabulation of a function of two variables 2 -* / y) 
leads to a table with two entries. Multi plicat ion tables 
are the most widely used tables of this kiiul. 


1 

•> 


4 

r* 


' 


i) 

541 

1082 

1623 

2164 

27»)5 

3246 

3787 

4328 

4869 

542 

1084 

1626 

2168 

2710 

3252 

3794 

4336 

4878 

543 

1085 

102!) 

2172 

2715 

3258 

3801 

4344 

4887 

544 

1088 

1632 

2170 

2720 

3260 

3808 

4352 

4896 

545 

1090 

1635 

2180 

2725 

3270 

3815 

4360 

4905 


In Table 7.4 the three-digit multiplicand is written in 
the left column and one-digit multiplier is writ leu in the 
upper row of the table. 'The step of both entries is equal 
to unity. To obtain the product of a three-digit number 
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m 

by a one-digit one, it suflices to lind the row whose lirst 
column contains the multiplicand and choose the column 
containing the multiplier. The required product is in the 
row and columns obtained. 

Example 1. We have to multiply 543 by 8. In Table 7.4 wo 
find the row with 543 in it and the column numbered 8. At their 
intersection we read the number 4344, and this is the required 
product. 

To multiply multi-digit niimhers, we divide tlic multi- 
plicand into parts containing not more than three digits 
and apply the technique describod above to each part. 

Example 2. We have to multiply 541 544 by 37. We divide the 
number 541 544 into two three-digit parts 541 and 544. Then wo 
successively multiply each part by three tens and seven unities and 
add the resulting partial products together: 

541 X 30 = 1 6 230 544 X 30 ^ 1 0 320 

541 X 7 -= 3 787 544 X 7 -- 3 808 

20 017 20128 

We place the first partial product three decimal places to the loft 
of the second product and sum up: 

20 017 
20 128 

20 037 1 28 ‘ 

And this is the required result. 

When you work with tables, please remember that there 
may be peculiarities in their arrangement. Therefore, wiien 
using a rcferenco book for tlie first tim(‘, got acquainted 
with its description. 

7.3. The Approximation Theory 

The theory of the approximation of functions and its 
practical applications are usually needed in problem 
solving. 

Assume, for instance, that in the process of an experi- 
ment, at the descrete moments Xq, Xi, . . wo obtained 
the values /o, /j, . . of a quantity / (.r). Wo have to 
reconstruct the function / (t) for other x 7 ^ Xf (i = 0 , 
1, . . ., N). A similar problem may arise when wo repeat- 
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t‘dly compulo ojio coin|)i>sile ' fuiicLion / at clinoront 
points using a compiitor. Insload ot doing repeated 
compulations, it may be expedient to calculate the 
lunction / at a small number of characteristic points Xi 
and calculate its values at other points employing a 
simpler rule with the use of the values // ~j{xi) already 
known. 

The problems of linding the derivative /' (./:) and the 

b 

integral {x) dx’ from the given values // can be cited 

a 

as other well-known examples of approximal ion of 
functions. 

Finally, the problem of approximation of functions also 
arises when algorithms of standard programs for calcu- 
lating eiementary and special functions are set up. 

The c*:is.. ical approach to the solution of these problems 
requires the use of the data on hand concerning the function 
/ in order to consider another function (| which is close, 
in a certaiji sense, to / and which admits of the requisite 
action on it, thus allowing I he estimation of the error of 
such an “analytic substitution'’. 

In the process of numerical realization of this approach, 
it is necessary to consider four principal problems. 

1. The problem of the available information concerning 
the function /, i.e. the form in which the function / is 
given. 

2. The problem of the class of the approximating func- 
tions, i.e. of th(‘ funclions ((> by which I be function / 
will be approximated. 

3. The problem of the closeness of the approximated 
and the approximating funclions, i.e. of the choice of the 
t(\st of goodness of lit which the function (p must satisfy. 

4. The problem of the error, i.e. of the estimation of the 
difference of the exact and the approximate value. 

There are two principal cases in the problem of the data 
on the function /: either the function is debned analytical- 
ly or it is tabulated. The graphical method of represent- 
ing a function refers either to the hrst or to the secorjd 
ease according as the specilic probUin posed. In what 
follows we shall consider, on the interval 1^7, b], func- 
tions / (a*) which are coni inuous together with a sufficient 

18 * 
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number of their derivatives and defined by tlieir values 
ii — I J nodal points of the given net 

jY- <C • • • ^ (^) 

As concerns tlie class of the approximating iiinctions, 
wo must proceed here from two main iactors. First, the 
approximating function must reilect the peculiar ieatures 
of the function being approximated and, second, it must 
be convenient enough to be manipulated, i.e. admit of 
various actions perforjned on it. 

In numerical analysis wide use is rnadi' of three groups 
of approximating functions. The first group includes 
functions of the form 1, :r, . . ., x^\ whoso linear combina- 
tions generate a class of all polynomials of degree not 
higher than n. The second group consists of trigonornel ric 
functions sin afX and cos (iix which generate the Fourier 
series and the Fourier integral. Finally, ihe third group 
consists of exponential functions which d(9iue phe- 
nomena of the type of decomposition and cumulation often 
encountered in reality. 

Later on we shall consider in more detail the polynomial 
approximation, i.e. we shall take a polynomial of a di' 
gree n as the approximating function. 

In this case the approximating function is usually di'- 
signated as P n {^) Ihe form 

(p (j:) = P„ (.r) 2 "h-'r"- (-) 

The problem concerning the lest of goodness of fil 
consists essentially in defermining sonudiow Ihe “dis- 
tance” between the approximated and Ihe approximating 
function and choosing, from tlu^ whole cla^s of approxi- 
mating functions, the function for which this '‘distance” 
is minimum. 

Chebyshev’s method “of fitting” is tlu' most frequently 
used test of goodiu'ss of lit. It is based on thi' conc(*pl of 
the dis.ance as the maximum value of Ihe ih^vialion of llu' 
function rp from the function / at the nodal points .r,; 

p,= max I /(t;) — <p(x,) |. (;^) 
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Of c\sp(‘cial inlemsl is the special case when llie distance 
0 for the approximating function. Tliis means that 
for the tabulated function y — / (x) (hdined hy its values 
!Ji // “ / i-^i) 


•^0 

•rj 

XN 

Uo 

//i 

UN 


we havi^ lo construcl an approx imating funclioii (j (.r) 
which coincides, at the notlal poinls.r,, wilh Ihe values of 
the given function // -- /(./), i.e. such that (u ,) — //,. 



ddiis melhod of approvimatiori, based on ihe lesl for 
goodness of lit of / and (| ai the nodal points .c, is knoxMi 
as iftlerpolalion. Jf Ihe argument .? for N\hich tin* approxi- 
mate valiK' of Itie fund ion is soughi belongs to the inter- 
\al [.Cq, .c^y], then tlu' probhuu of limling the valm of tlii' 
function at the point .r is called interpolation in the arrow 
s'cnse. iNow if the argument ./ is outside of the interval 
.r y], tluMi llu' problem posed is calh'd eutr/^ point ^on. 

In t('rms of geometry, the problem of interpolation for 
a function of om^ variabh^ // - / (r) niean> a construction 

on the .f/y-plane, of a curve which will pass through the 

points wilh coordinates (x,), y^^), (.c,, /y,) (.r^v, // v) 

(Fig. 7.1). 

Here is one more example of the test of goodness of lit. 
We inrodiKU’ tlu* concept of the distanci' between the func- 
tions / and (| as the sum of the sijuares of their deviations 
at the nodal points: 

V 

I' i (•»■,)]“• 


( 6 ) 
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Now we choose, as the approximating function, the func- 
tion for which p is minimum. It is expedient to use this 
test when information is plentiful but is specified with 
a low degree of accuracy. The method of approximation 
based on this test is often called the method of the least 
squares. The advantages of this method are its simpli- 
city and the order and harmony of its mathematical 
theory. 

\nd now the last problem, that, concerning the ficcura- 
cy of the solution obtained. Iji many respects it is the 
main problem. Indeed, in the final analysis the quality of 
a melliod depends primarily on the speed of obtaining 
a result with the required accuracy, or, as wo say, the 
rale of convergence. It is therefore evident that the choice 
of the nodal points, of the class of approximating func- 
tions and of the test of goodness of lit must serve one pur- 
pose, the required accuracy. 

At first glance the problem of the accuracy of the solu 
tion seems to be very simple: the approximate solution 
must differ from the exact one by not more than the 
specified p. However, the question of the possibility of 
arbitrarily close approximation of the function /, wliich 
depends on the “parameters” enumerated above (the nodal 
points Xi, the class of functions q , the test of goodness of 
fit of / and ip) remains open in the general case and must 
be investigated for every specific process of approximation. 

7.4. Interpolation by Polynomials 

Let us consider in more detail the problem of interpo- 
lation of the function / by algebraic polynomials. 

In this case the approximating function (() is usually 
designated as (a;) and has the form 

(f)(x)^P„{x)= S flfta:"-''. (1) 

ft =0 

The choice of the specific value of n depends, in many 
respects, on the properties of the function being approxi- 
mated, on the required accuracy and on the interpolation 
nodes. We shall see later on that tlie choice of the quanti- 
ty n is affected essentially by the process of computation 
which may add an error to the result, 
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Tlic condition of coincidence of / and q; at the nodal 
points is evidently assumed to be the test for goodness 
of (it. 

Jt is natural to assume that for an unambiguous deter- 
mination of n + 1 coefficients of Ihe polynomial it 
is necessary to require the coincidence of / and at 
(lie {}i 1 1)st nodal point: 

nx,)=Pn{Xi) (t - 0, 1, . . (2) 

Till' polynomial {x), which satisfies conditions (2), 
is known as an inter])olatln^ polijnomiaL To emphasize the 
(lopcmdence of this polynomial on tlie function /, it is 
oftem designated as P (/, .r). 

The error of interpolation Aj in the case when it is 
necessary to calculate the value of the function / {x) at 
om’ point x*, is understood to he the absolute value of the 
diffm'eiKo ox J exact and approximate values: 

A, - \j{x^) - /^, (x*) |. (2) 

lint when the interpolation is carried out on the whole 
interval h/, the maximum dexiation of the polynomial 
from the function / on tin* interxal in question is 
assumed to be tlie error: 

A, max I / (.r) — P^ [x) |. 

[aM 

Let us consider the following inti'rpolation problem. 
The values /f ~ / (x,) (t — 0, 1, . . n) of the fujution/ 
are si)ecified on the net A;,: a .r,, <i <i . , . <C v ^ 
at the nodal points Xi. We have to construct an interpolat- 
ing polynomial xvhich would coincide' with / at the 
nodal points x, and estimate the error A,. 

The existence and uniqueness of the interpolating poly- 
nomial follow from the theorem given below. 

Theorem. Let: (1°) a net A„: .r„ d .Ti < . . . < 

d h is i,nren on the interval [^/, bl, and (2'') arbitrary 
nunibers c, (/“(), 1, . . n) are specified. Then there is 
a polynomial /^, of degree not higher than n, which assumes 
the assigned values Ciat the nodal points a:,, and this poly- 
nomial is unique. 

f nFrom the conditions for determining the unknown 
coefficients Oj, of the polynomial Pn we obtain a system 
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of algebraic equations 


floJ-i -I 

- -!-••• -!“ On Ci (i 

- 

0, 1, 

. . ri). (4) 

Tlio 

determinant of 1 

his system 






. . . .r„ 

1 





j.n ^w-i _ 

1 


(r») 



y.71-1 ^ 

1 




is a Vaiiderjuoiule determiiiaiit which, as is kjiowri I'roiri 
algebra, is iionzero if the condition .r/ is salislied 

for / ^ j. This condition is ovidenlly fulfilled for tlu' net 
A, I being considercHl. (Consequently, system (4) has a iini- 
qiic solution (a unique collection of cocflicients a;,.). ■ 
It is evidejit that if we take the values of the func- 
lion / at the nodal points .r,- as Ihi^ number c,,we shall 
obtain a statement on th(» existence and uniqueness of the 
interpolating polynomial (/, •?*)• 

The coetTicieiits of the interpolating polyjiomial (1) 
can be found by setting /, in system (1) and solving 
th(* system using, say, Cramer’s rule: 

^ i\JW. (()) 

Here A/, is a determinant obtained from \V as a result of 
the substitiiiion of the column /, of the coiislant tiTins of 
system (4) for the column of terms containing the (ti — /r)lli 
power of Xi (i =r 0 , 1, . . n)\ 



Tq . 

Ji — h -{- 1 
•• ^0 

fo 

71- k-i 

.. 1 

II 

< 


■ ■ 

/. 

.1 j 

.. 1 


• ' 

n~k\-\ 

' ■ ^7L 

fn 

n -h-l 

7L 

.. 1 


(7) 


Substituting the values of a/, obtaim*d into ndalion (1), 
we arrive at a new form of representation of llie interpo- 
lating polynomial (/, x): 


Pn 1 X j:” 

fo 1 ^0 ^0 
fn 1 


0. 


( 8 ) 
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Nolo that in ])ra(‘lice we usually use interpolalinj^ poiy- 
riomials of the lirsi and the second decree. And then wo 
speak of the linear and quadrat ic interpolation. 

Example. Using the nodal points x^ and the corresponding: 

values /o, /j, /.^ ol' a function, construct an interpolating polynomial 
representing it as a linear combination of the values /; (i - 0, 
1 , 2 ). 

A According to lorniula (8) we liave 

P, 1 X 

/o i -ro ./J 

fl 1 .Tj .r? 

1 X., 


Expanding tin' determinant according lo llie (‘lemenls of IIk' first 
column, we obtain 



\ Xq J 0 


1 X 


1 X ,/“ 


1 .1 

1^2 

1 Xi x ^^ 


1 /*! XX 

-l-/l 

1 .fo -’ii 

^2 

1 J-,, .15 


1 2 2 ' 


1 .1 , xl 


t ^^2 


I -Cf 'i 


Taking into account that 
1 .r, x'l 
1 




(i j -Xi) {JU — {’'h ' 


- - 0 . 


we linally obtain 


‘ 'l) ' ('-i - ,,) 


■ (^*> -‘*o) 


7.5. The Error of [nterpolalioii F^rocesses 

Assume that the fimclioii / is approMjnated hy an 
inl(‘ipolaliug i)olyiH)Tiiial, i.i‘. 

f i-i) \ li „(.>), (t) 

wlii‘ri‘ //„ (./) is (lie remainder of llie iiilerpolal ion for- 
mula 

! (r) ^ /^. (.r). (2) 

The i‘(*maiuder depimds on many f.clors sucli as lln‘ 
properties of the function f. the intert)olal ion parameters, 
lh(» })osilion of the point of in1erj)olalion. Therefore the 
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study of (x) is a difficult problem. First of all we must 
estimate the error. If the point of interpolation x* is 
fixed, then it is natural to take the quantity = 
I R„ (x*) I as the estimate of the error. Now if the 
point X* is unknown and the interpolation is carried out 
on the interval [a, 6], then it is expedient to take the 
quantity 

Ai-=max |i?„(a;) I (3) 

[a, (.] 

as * sliniate of the error. 

Other estimates of the error can be chosen depending 
on a specific problem. 

As a rule, the estimate of the error is sought not for 
an individual function but for a whole class of functions 
with some common properties. 

We shall derive an explicit expression to estimate the 
error (3) of the interpolation formula (2) for the class of 
functions (a, b) which have a continuous derivative 
of order iv + 1 on the interval [a, 6]. 

For this purpose we prove the following theorem. 

Theorem. Assume that: (l'^) the nodal points {i = 0, 
1, . . n) are distinct and belong to the interval [a, b] 
together with x*, (2°) the function j has a continuous deriva- 
tive of order n \- \ on [a, 6]. Then there is a point ^ g (a, b) 
such that 


Rn U’*) 


/("H) (£) 


n (■>’*- ^i)- 

i=0 


( 4 ). 


□ Note that if a:* coincides with one of the nodal points, 
then relation (4) is satisfied since its right-hand and left- 
hand sides are zero. Therefore we shall assume in what 
follows that X* ::^Xi (i = 0, 1, . . n). We shall consi- 

der an auxiliary function 

fix)-P,ix)-k fl {x-Xi), (5) 

i=0 


where /c is a constant chosen such that the function ^ 
vanished^ at x = x*^ i.e. 

n 

'F(a:*) = 0 = /(a:*)-P„(x*)-A: ]I (x*~Xi). 

4=P 
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Hcnco 

f{x*)-Pn{x*) ^ Rnjx*) 

II (^* — ^f) II 

i =0 i ~^0 

By virtue of such a clioicc of k tho function vanishes on 
the interval [a, 6] at least n h 2 times at the points Xq, 
Xi, . . x^y .r*. Then, using Rolle’s tlieorem, we can 
state that in the interval (a, b) the derivative T" van- 
ishes at least n + \ times, the derivative vanishes at 
least n times, and so on, up to the derivative which 

vanishes at least at one point, say, at the point | g (a, b). 
Differentiating now tlie right-hand and left-hand sides 
of relation (5) n -\- 1 times with respect to x and then set- 
ting X — I, we get zero on the left-hand side since 
^Tin+i) _ Q term on the right-hand side 

yields the value of the derivative at the point 
The second term on the right-hand side yields zero being 
a derivative of order n |- 1 of a polynomial of degree not 
higher than ri. The third term is the product of the con- 
stant k by a polynomial of degree n -\- 1 with the leading 
coefficient 1; tho derivative of order n + 1 of this poly- 
nomial is evidently equal to (n -f 1)!. Thus, summing 
up all we have said above, we liave 

0 ^ (1) {n h 1 )!. 

Replacing k in this relation by its expression (B), we get 
tho required relation (4). ■ 

Assume now for definiteness that 

1 /(’•-*) (.r) re [a, 61. (7) 

Employing this restriction and the theorem we have just 
proved, we arrive at the following estimate of the error 
for the fixed point j*: 

n 

A,-. (8) 

i=0 

It is now easy to construct the estimate | |, uniform 

throughout tho interval ft], for the fixed net A„, namely, 

Aj--max I /?„ (x) |(o„(x)l, (9) 

[a, 6] Jo, b] 
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where 


Wn (a:) ^ 


11 (x — Xi). 

i =0 


Example 1. On the interval [—1, 1] get a uniform estimate of 
the deviation of the function f—i— cos (nxl2) from its interpolat- 
ing polynomial constructed on the nodal points xi = — 1 + — 


(i = 0, 1, . . w = 2, 3, 4). 

A Note first of all that for the function under consideration 
+1 = on the specified interval. Therefore, by virtue of 

estimate (9), the solution of the problem reduces to the estimation 
of the quantity max | {x) |. This can bo done according 

[- 1 . 1 ] 

to the ordinary rules of mathematical analysis. 

1. Let us consider the case n — 2. Then 


( 1)2 {x) = (jr -[- 1) X (x — 1), (Do (x) — 3x“ 1 . 

The roots of the polynomial 0)2 (x) are Xj.g ==- rt 1/ I 3 -± U.5774. 

Substituting the values obtained into the expression for Wj, we 
obtain 

max I w., (i) I = I < 0 , (I,) I = 2/ s 1 1.384!) 

[- 1 . 1 ] ■ 


and, consequently, 

Ai< 



3! 


2. L(?t now n = 3. In this case 


2 

J^27 


^ 0.25. 


U):,(t) -(i-l 1) 


(oi (x) ==4x3 j. 


The roots of the polynomial coj (x) are Xj = 0 and 

± 15/3 ^ ± 0.7454. It is easy to verify that the maximum 
value I (Og (x) | is attained at the points X 2 and x^: 

max ItOg (x)| = 1 0)3 (x..)| ^10/81 ^ 0.1 U75. 

[- 1 , 1 ] 


Therefore 


. ^ 1 16 „ 


3. For n - 4 we reduce tlic estimate of 

W4*(x) = (x-f i) 3: (j — 1) 
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to the estimate obtained in item 1. Indeed, since CO4 (j;) is odd, we 
may only find the maximum value of | CO4 (a;) | on the interval [0, 1). 
In this case 

max I (O4 (a-) I < 2 • • max I ^ ^ ) (x -- 1 ) I . 

[0, 1] ^ to, 111' ^ f I 

lJsinj»’ the formula ^ ~ 2 change the variable on the 

right-hand side of th(5 relation obtained and taking into account tlie 
results obtained in item 1, we get 


3 max 
l<i. il 


Thus 


^ -4") (* — 1) max |(!/ + 1) '/(tf — l)! 

' “ ' ® [-1, 1] 


1 




^ 11.1443. 


max |(i), (x) < 1/K48 ^ (1,1443 

r -1. 1] 

and the required estimate 



5! 


-^=- 0 . 012 . 

r"^48 


A 


Thi.s example seems to substantiate the assumption 
that eslimato (9) is practically suitable and assumes small 
values for tlio majority of functions for sufficiently 
large n. However, in many cases this is not so. 

The matter is that only for a small class of functions 
(say, for entire functions) the derivatives of sufficiently 
high order are small, but for the majority of functions 
some of higher-order derivatives have a tendency of grow- 
ing as n\. As an example let us consider the function 
y = In X. For this function, evidently, = 

vicinity of points 

wliere (he curve // = log x seems lo be smooth ils deriva- 
lives of sufficiently high orders become very large and 
behave as 

The drawback of polynomial approximation is the ab- 
sence, as a rule, of a physical meaning whicli usually leads 
to u.seful generalizations. 

On tlie other hand, the simplicity and the tliorough 
dovtdopment of the theory of polynomial approximation 
in conjunction with the minimum of computations make 



302 


Computational Mathematics 


this kind of approximation a convenient tool for solving 
various problems, all the more so as the experience of 
practical computations leads to good results of approxi- 
mation by polynomials although either it is difficult to 
estimate the remainder or its estimate is too high. 

We have thus considered only one aspect of tlie problem 
concerning the error, the effect of the properties of tlie 
function / on the quantity A^/rhe problem of the depend - 
eiice of the error on the arrangement of the nodal points 
of the net is closely connected with the properties of 
Cliebyshev’s polynomials and, therefore, we shall return 
to the study of this problem after we consider these poly- 
nomials. For the time being, wo shall restrict our coiisiil- 
eration to one of the possible estimates of the quantity 
I (On (j:) I on the fixed net A,i. Let x be between Xk and 
We set max (xi — = h and then 

<=o 

( 10 ) 

We cat! therefore write inequality (8) in the form 

A,=-maxIi?„(x)l<^fe’-+*. (12) 

[a. b] 

Note that estimate (10) is rather rough and can be easily 
improved (do it independently as an exercise). 

Example 2 . With what accuracy can we calculate >^117 using an 
interpolating polynomial for the function y = Y Xy taking 
100, xi = 121 and x^ = 144 as the nodal points of interpolation? 

A First of all we determine M^= max To do 

[ 100 , 144 ] 

this we find 

3 3 

Hence Mg = -Q- • 100-6/2 =—. 10 - 6 . Therefore, on the basis of 
o o 

relation (8) we have 

A, <-|-.10-».A|(ii7_1()(i)(ii 7_121) (117-144)1 ^n.l 2 .oi-!!. 4 
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7.6. Lagrange’s Interpolating Polynomial 

A direct determination of the coefficients aj, of an 
interpolating polynomial encounters some computational 
difficulties. Therefore, when we solve practical problems, 
we deal with special kinds of an interpolating polyno- 
mial. 

In this section we consider the form of an interpolating 
polynomial which is known as Lagrange’s form and is 
usually designated as (x). To construct L„, we shall 
first consider auxiliary polynomials li (x) of degree n 
which posse.ss the following two properties: 

h i^i) = 1 (t = 0, 1, . . ., n), (1) 

h i^k) = 0 (i /c; t, k -^0, 1, . . ,, n). (2) 

These properties mean that, for in.stance, the polynomial 
Zq (x) assumes a value equal to unity at the point .r^ 
and vanishes at the otiicr nodal points; Zj (x) assumes 
a value equal to unity at the point and vanishes at the 
other points and so on. In the general case, the polynomial 
li (x) assumes a value equal to unity at the nodal point 
Xj and vanishes at the other points. Thus, by virtue 
of property (2) and the requirement that the polynomial 
Zj (x) should be of degree n, we obtain 

I, (x) = Cl (X — Xo) . . . (X — Xi_i) (X — Xi+i). . . 

• • -(^ — ^n)- (3) 

Furthermore, using property (1), wo have the foJlowing 
equation for determining the constant C|: 

(^<) = c, (x, — Xo). . . (Xi — 

X (X/ • • (•J-'j ^n) ~ 

From this we have 

(X|— a-o) ... — ... (Xj— x„) • 

We can therefore represent the explicit expression for 
Z, (x) as follows: 

/ / x (g — Jq) ■■ ■ (x~xi-t)(x — xui) ...(x~x„) 

'' ■ (Xi— Xo) ••• (*1 — a-(-i)(xi-a;|+i) ... to— Xn) ' 


( 5 ) 
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Let us now set up the following linear combination of the 
polynomials I,: 

= S (fi) 

i-0 

Expression ((>) is a polynomial of degree not higlier 
than w. At the nodal point Xi this polynomial assumes 
the value fi since the corresponding term of the sum 
/^Z, (Xi) is equal to h and the other terms of fjlj (.r^) are 
zero. We have thus constructed an interpolating polyno- 
mial for the function / (x). This form is known as Lagran- 
ge's interpolating polynomial. 

Taking into account that 

Wn (^) = {pr — ^o) — -rj). . . (.r — .rj, 

we can consider its derivative at I he point xp. 


(o; {Xi) = (Xi —x^). . ,(Xi —Xi^^) (.r,. — • • 

• • n) 

and write Lagrange’s polynomial as 




(a; — (r^) 


The quantities li (^) are the weight polynomials of the 
corresponding nodal points and are often called Lagran- 
ge's multipliers. In addition to properties (1) and (2) we 
shall consider one more important property of these 
multipliers: 

S li(x)-i. (8) 

i=0 

Indeed, assume that / (.r) = 1, and then all /,- — 1 (i -= 0, 
1, . . n). On the other liand, (a:) = 0 and, by 

virtue of the theorem presented in 7 .5, L^ (x) — f (x) = 
1. Substituting the expression obtained into (()), we 
arrive at relation (8). 

Example 1 . Using the nodal points = 0, jT] = 1/3 and — 1 , 
construct Lagrange^s interpolating polynomial for the function 
/ = sin {nx/2y and get a uniform estimate of the error on the 
interval [0, 11. 
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A Note first of all that / (arg) = 0, / (ari) = 1/2, / (xz) 1. 
Then, using expression (7) for n 2, we construct the required in- 
terpolating polynomial: 


1 

X (x— 1) 

a: 1 

\4 

('-t) 

2 

-Ht-) 

-j- 1 

^ 1 

(-4) 


It is ou.sy to obtain tlio nstimato of the error fromrela- 
tion (8) given in 7.5 for n — 2: 

ol fo, 11 * ' ' 

Tn tlii.s cast', evidently, - (ji/2)3 and max \ x(x — 

I [0. n ^ 

(•^* — 01 ' 0.079 and wo can dettTmine it in the same 

way we dlH if in Example' 1 of 7.5. TJierefore the final 
result is 

A,< (?-)■’. -j-. 0.079 ^0.05. A 


Example 2. The function / (./:) is tabulated as follows: 


X 

0 

LM 

2 

1 

y 

-1 

1 -- 3 1 

3 

1187 


Using T.agrange’s interpolating polynomial, we find its value at 
the point z — 4. 

A Substituting' the values of Xf and fi for n = 3 and x - 4 into 

formula (7), we obtain 


^ 3 ( 4 ) 


(4- -l)(4-2) (4-6) 


(-!)(- 
l)(4-6) , 


- 2 ) (- 6 ) 
4(4 


3 - 


4(4 2) (4- -6) 


2(2-l)(2 -fi) 


1187. 


1 ( 1 - 2 ) (1 
l)(4-2) 


- 6 ) 


6 ( 6 - 1 ) (6 - 2 ) 


= 255. 4 


If wc add one more point lo the table in Ibis example, 
wo must caknilale the value of the function for x — 4 anew. 
Ilosides this, it is seen from the example itself that the 
process of approximating the function with the use of 
J^agrange’s formula is connected with long calculations. 
This generates a need lo simplify the computations. 

To make the compnialions easier, wo compile the 
following table. 


20-0104 
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1 

u 

o 

Xq Xi 

Xq X2 

... J 

^ 0 - 

h 

Xi Xq 

X Xy 

Xi X2 


^l — ^n 

ki 

X 2 — ^0 

X2 ^ J 1 

X X2 


X2 Xji 

h 

... 

... 

... 

1 

... 



Xn — Xi 

Xyi X2 

... j 

X Xji 

kn 


where Xyj are the interpolation nodal points 

and X is the value of the argument for which we determine 
the approximate value using Lagrange’s interpolation 
formula. We designate the product of tlie elements of the 
first row as k^: 

ko =- {X -Xn) (j-o — Xi). . . (Xo — x„). 

In the general form, the product of the elements of I he 
ith row. is 

ki = (X; — a'o) . . . (Xi — Xi_|) (x — Xi) 

X (xj • • • (•*”/ 

We place the numbers Icq, /Cj, . . kn in the extreme right 
column of the table. In addition we calculate the product 
of the elements which lie on the priiicij)al diagonal: 

(•>n (X) = (X — Xo) (X — X,) . . . (X — X„). 

Then we can rewrite Lagrange’s inlorpolaling polynomial as 

n 

/.„(x) -6.„(x)2y.-. (») 


Using formula (9), we solve Example 2 anew. We coin])ile a table 


4 

1 

-1 

-2 

-0 , 

-48 

1 

4-1 

1—2 

1 1 

15 

2 

2-1 

4-- 2 

2-0 j 

-16 

6 



I 4-0 1 

-240 


and find that ©g (4) = — 48. The approximate value of the func- 
tion at the point x ^ 4, l.e. / (4) Lg (4), can be found from the 
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lormula 

/,3(a;) = ti)j(i) 2 -fr * 
i^O ‘ 


or 






3 

- 10 


1187 
— 240 


]-25r,. A 


Lagjrarige’s interpolation formula is noticeably simpler 
when the interpolation nodal points are eqiiispaced, 
i.e. h = Xi^i — Xi = const, where fe is the step of inter- 
polation. We introduce the designation t = (x —XQ)/k. 
From formula (5) we have 

I ^ / X „ (.r — Jq) — — ...(j — 

* ^ ^ (^i— ^o) ••• ••• (■r/— 

Since 

X — ^0 

X — .rj =z th — h h (t — 1), 


:r — Xf — th — ih ^ h {t — i), 


X — Xj^ -- th — fiJi ^ h (t — /?), 
it follows that 


' \h{ — \)h (n ~i)h\ 


( 10 ) 


Nole that a part of the product in the denoinin. 'or is 
ih (i — 1) h h ^ /! 


and tlie other part is 

i-h) ... l—in^i)h]~^{-lY^-'^{n-^i)\ 

Multiplying the nnnierator and denoiuinalor on (he right 
hand side of relation (10) by ( — 1)’' ’ — i)^ xve obtain 


I ^ 1) » . . {t n) / 1 

" (t-i)i! (n-i)! ^ 

{ 1 ( / ) t (t 1) • • ( t a) 

^ t-i n\ 


where ^ ” 


ji\ 

z!(n--i)! • 


30 * 
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Tficii Jjagran^e’s interpolating^ polynomial for the equi- 
spaced nodal points of interpolation can he written as 


(•^') -- (^0 f 


i{t — 1) ... (t — n) 
n\ 


” (") 

x2 

i=r-0 

Example 3. The function y = sin a; is tabulated as 


( 11 ) 


X 

0 

ji/4 ji/2 

y 

0 

0.707 1 

Using Lagrange’s interpolating polynomial, 
point j:* - JiA). Estimate the error A,. 

A We first find / ^ 

Jl 

"6 

"){^r 


Siihsti tilting 

the value o'f wc have obtained and the values of for n 2 into 
formula (11), wc have 


2! 


J _ (2/3- lH2/3^ 2) 

/ .2 2 

I 2/3-0 ■" 2/3 — 1 




) -((.517. 


To estimate tJie error, wo use formula (8) from 
A/3 - max |(sin .r)'"| -- 1, .r* ~3x/t>, and therefore 
[()./r/2] 


1 JC JX Jl 


0 . 024 . 


7.5. Tlore 


Note that when calculating the error wo must turn the degree mea- 
sure into a radian one. 

Thus, rounding off the result to two decimal places, we gel 
sin (jT,/()) -- 0..52 db 0.03. ^ 


7.7. Finite Differences 

In the preceding sections wc considered various problems 
of the interpolation theory on an arbitrary not of nodal 
points. In practical computations the information about 
the function (in the form of its values) is often given on 
a uniform pel, i.o. for equisjiaced nodal points. In this 
case, not only the forms of tlie interpolalion polyjiomials 
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become simpler, J)ul the computation process is dimi- 
iiislied, and this is a laclor of "Teat sionincance in practical 
computations. Wlien conslrncting interpolating polyno- 
mials on a uniform net, we use qnantilics known as 
finite differences. 

Consider a nnifonn net with a step h: jci — |- 

Ui (i = 0, ±1, ±2, . . .), at whose nodal points tlie 
values of ft = / (r^) of the function / (.r) are given. 

Three types of linite differences can he encountered in 
mathematical literature: forivard differences A'V/, backward 
differences vVi central differences cVY/ — 

A finite difference of the first order is a difference between 
(he values of the function at the given nodal point and 


at Ihe 

l)rcceding 

one: 






fo - 

-A/„ 

V/,-6/,/, 

/1/2. 



/.- 

/, 

-Af,- 

Vf, -6/3/,- 

- /J/2, 

0) 


/mi - 

/, 

- Ni 

6/,- 

H/2 


'This delinition 

can also 

bo wrillon 

as 


A/,. 

fn-. 


^fr 

1,-fi-t, 6/, 

■■ fi ^ I/J fi-l/-2’ 

(2) 


\ fn/itc diffciCfice of the second ordei i.^ a difference be- 
iNseeii the values of I he lirst Ihiile difference at a given 
nodal point and I he preceding one: 

A-/, - A/, + ,- AA, VV/- V/,-V/..p 

t’inih' differences of an arbitrary order k are dehned 
in a sijnilar way: 

A"/< 

VV; ('«) 

In some interpolal ion formulas ct asidered below, in 
addition lo differences (4) we use Ihe arithnielic means of 
the adjacent finite differences of the same order; 
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V'fi ^ y + /i- l/2)» M'/i+l/2 “ y {fi+ 1 + /i )• ('^0 

TJio lirsl of these quantities is used for an odd k and the 
second, for an even /r. 

It is convenient to write the finite differences of tlie 
function / as tables. In that case the ])ackward and for- 
ward finite differences are written as horizontal tables 
(Tables 7.5 and 7.0) and central finite differences as 
central tables (Table 7.7). 

Let us consider some properties of liiiile differences. 

'ruble 7.5 


X 

/ 

A/ 


A-’/ 1 

AV 


fo 

A/o 

AVo 

A»/« 

AVo 

XQ-\-h 

/x 

A/i 

A'Vi 

A='/i 


jQ-\-2h 

I 2 

1 A/a 

1 AV 2 



XQ-{-3h 

/s 


... 



Xg + ih j 

1 /4 

i 




... 


... 





Table 7.G 


.r 

/ 

V/ 1 

1 V*/ 

V'V 

yif 



... 




Xq — 4/i 

/-4 

... 




.rg — 3/i 


V/_3 


j 


XQ — 2h 

/-2 

1 

V/-, 

V*/_2 



Xq~ Ji 

/-X 1 

v/_. 

V“/-, 

V'"/- 1 

... 

^0 

- /o 1 

1 '^^0 i 

VVo 

VVo 

V''/o 
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Table 7.7 


X 

1 

6/ 

62/ 

6V 

b'l 



... 


... 

... 

-2/1 

u 







{>Ul2 




Tn -h 

u 


6*/-i 





6 /- 1/2 


6^/-. /a 


^0 

lo 


6 V 0 


67o 

! 

! 

Wl /2 




.roH-/t 

1 

/5 


67i 





^ 1^/2 




.Vq I 2h 

/a 












r\ Fonrdrely backirard and central differences are con- 
iicctcd hfj the relations 

V'7i+„ 6 V,h,/.. ('7 

which we c.Mi easily ja^ove by imluclioii procLM'diiii^ Iroin 
the (lerniilioii ol Lho linile dilTerencos (4). 

□ Kor k ----- \ relations ((>) are obvious since, by virtue 
of rela lions (1), we have 

■ /iCl /n V/tf-i' /iHi ii"! + /i* 

J^el now relations (b) hold true Tor any /// — 1. We 
shall show lhal, in this case Ihey are also valid for k ni 
and, conse(inenl ly, for all k. IJsiny; relations (4) and the 
assnmpLion on the validity of ((>) for /r:^ m — 1, we have 

A^/,- + 
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<+— *+-2^ ‘+-r 

2'’. The finite difference satisfies the equality 

A (af + bg)i = a Aft -1- b Agi, (7) 

where a and b are constants. 

□ Indeed, 

A (af + bg)i afi+i -I- bgi+i — (afi + bgi) 

= a Afi bAgi. ■ 

Tliis property means, in particular, (hat the huile 
difference of the sum or the differei^co of two functions 
is equal to the sum or the difference of the Unite differ- 
ences of those functions respectively and also that the 
(inite difference of the product of a function by a constant 
factor is e.qual to the product of that factor by (lie I’lnite 
difference of the function. 

3^^. A finite difference is connected with the coi'respundiny 
derivative by a relation 

AVi- \^{x^,Xi-Ykh). (8) 

A consequence of relation (8) is that liiiiti* differences 
of order n of a polynomial of dej^ree n are constant and 
cqTJal to h*^n\aQ and finite tliffercnces of any hi^dier onhu* 
are equal to zero (^o is a coefficient of the polyjioinial in 
the highest degree of x). 

4°. A finite difference of order k can be represented as llie 
following linear combination of the values of fp. 

h 

( 0 ) 

i=0 

where ( ^ ] • -rrrr^—rrr is tlie numl)er of coinbinal iojis 
\jI 7l(A: — y)! 

of k elements taken / at a time (with 01-1). 

□ We use induction. For k — i this relation is obvious 
since it is a definition of the first finite difference: A/, 
/.•+1 -fi. 

Let now relation (9) hold true for some k - m. Tlieti 
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“m 111 

- S ( “ ly ( 7 ) /h lM„-~ 2 ( -I)'" ( 7 ) /i ^m-/ 

i— 0 j=-o 

7/t 

- C) /»,*„+ s (-!)'( 7)1 

j 1 

/n+1 

H-ir-'C I;;)./,- S (-ly 

i-0 

Wc liavo ui5C3d the properties of combinations: ( . j ^ 

("D-O O-G!) '■ 

Tlius if rclalion (D) holds Iriie for k -= //?, llien il also 
holds l.iUi lur k =~ iit 1. ■ 


Example 1. Coinpilo a horizontal table ol llie finiU' dilfereiices 
(d' the function y -- -| 3.c‘-* — x -- 1 prociM'din^ from the iiiilial 

value X 0 and lakinj^ k -- I as a step. 

A Scltinjy =- 0, xi — ^2 “ • • M we find lliu corre- 

sponding values: 


X 

1) 

1 

2 

3 1 

i 4 

1 

5 


y 

- 1 

2 

17 

50 

1117 

1U4 



We seek the hnite diJferences of the first order: 

Ai/o !/i - - !/o 2 — ( 1) 3, 

Ai/i 1/2 — i/i -= 17 — 2 15, 

//.» — 1/2 — 17 - 33, 

~ Va — Z/t — 1117 — 50 = 57, 

av; 194 107=87 ,... 

Next wo seek the finite differences of the second ovdi r: 

A'-^i/o ^ Ai/i — A//o =-15 — 3 = 12, 

A-Vi == Aw., — Ayi -- 33 — 15 — 18, 

- ^y: - ^y\ = 57 - 33 = 24, 

A‘'‘j/3 - Aj/4 - Aj,3 == 87 - 57 -- 30, . . . 

And then we find ihe finite differences of tin* third order: 


A=V/o 

A-//1 

A*,/„ - 

18 

~ 12 

Is 

A^V. - 

A^i/, 

- A'^j/i =- 

24 

- IS 

ts 

A'V. - 

- A==i/3 

- X^y, = 

30 

- 24 - 

0 
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We see that the third finite differences con- 

stant. This can bo explained by the fact that the function / (r) is 
a third-degree polynomial. The tliird finite difference can also be 
found from the formula 

i.e. A^/^n (j:) 3! “ 0, and the finite differences of tlie 

fourth order are equal to zero. 

We compile a table of finite differences: 


X 

u 

\ 

Ay 

A’/y 

A®y 

A*// 

1) 

-1 

3 

12 

() 

(I 

1 

2 

15 

18 

0 

0 

2 

17 

33 

24 

1 ) 


3 

50 

57 

30 



4 

107 

87 




5 

104 






In what follows, it is expedient to tabulate finite' diffi'rences en- 
countered in calculations. ^ 

Since the initial values fi of the fund ion are given, as 
a rale, with a certain error e wiiicli is the rounding errors 
or rajidoih errors, it is advisable lo consider I he effect 
these factors exert on tlio errors of liigher-order I'lnile 
differences. 

We begin witli tlie influence exerted J)y random (UTors 
and llie rounding errors. Assume that wolia\egol j\ | a 
instead of Then tJie lable of Dijile differences assumes 
llic form shown on p. 315 (see Table 7.8). 

By virtue of relation (9) this means that I he error c 
in the differonce of order k is extended to I ho differeuci^ 

of order k~\ m with coefDcienls ( — 

Now if all tlie initial values h are given with Ihe same 
error then this error is extended to Ihe differences of 
order m with a coefficient 2'^ and grows rajiidly with an 
increase in m (A (/f ) '-= 2"^ e). 

If the derivatives of suflicieiilly high ordc'rs of the 
function / remain bounded, then it follows from formula (8) 
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Tabic 7,H 


... 


... 

... 

’i-2 





M-.'l/li 



'i-l 


/{tf-l-B 



M-l/J ® 


/^+3 Oj. 

/i-1/2 

I'l+e. 


/A+2_2p, 



i> 

M + 1/2 


rh + 3 1 ‘»p 

M4-1 I 





/h+l 

M+3/2 



'i+ii 









lJuil tlie corresponding fijiile differonces C decrease willi 
an increase in m. Therefore there comes a point where I lie 
errors of llie hnile differences resulting either from round- 
ing off or from the errors in tlie initial data, become com- 
parable with the values of the linite differences them- 
selves or even exceed them. (^onse(|uently, the data in the 
table of those differences wdll be, in essense, the data on 
the differences of the errors and not the data on the fun- 
ction and it will not he expedient to use il. In that case 
we say that llie order of the Iasi linile differences which 
can still he used in calculalions is the order oj correct- 
ness of the table of linite differences. 
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Example 2. Consider a table of values of the Tunc ti on / -- 
sin x\ 


X 

46° 

47° 

48° 

49° 

50° 

51° 

52° 

/ 

0.7198 

0.7314 

(t.7431 

0.7547 

0.766i) 

0.7771 

(1.7880 


All the digits in the table arc correct in the narrow sense. Com- 
pile a table of finite differences and find the order of correctness of 
tL ' table. 

A We calculate the finite differences and compile a table. 

Tabic i’.i) 



Note that it is customary to write finite differences in the units oT 
the last decimal place of the values of the function. 

The last row of the table contains the corresponding absoiiiLc; 
errors. Evidently, the absolute values of the third finite dilferoiices 
are comparable with their error and the absolute values of the 
subsequent differences arc essentially smaller than their errors. 
Therefore the order of correctness of Table 7.9 is 2. 

The fact that it is inexpedient to use finite diitmuices 
of an o«der higlier than two in (lie exanijilo given above ean 
also bo snbstani ialed as follows. Since llit' inilial dala on 
ji are given with an error f — O.ri-IO lluui il is nol 
advisable to take into consideration I he linile differences 
which are smaller in absolute value than the errors. On 
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tlie other hand, using relation (8), we get A'Vi = (ji/ 18())* 
and, Iherelore, I ho order ol‘ correchiess ol Table 7.9 is 
(lefiruMl by tJie following inecjiialilies: 

(ji/180)'^ > 0.5.10 (jt/180)'^^i, 

which are evidently satisfied for k = 2. 

fn I he general case, the order of correctness of a lal)Ie 
of linile dilTerences in this sense* is the h’ast value of k 
salisfying the inequality 

1^8, wh(‘n* Jiiax (10) 

We have discussed the influence exerted by the error of 
th(‘ initial data on the degree of the interpolating i)oly- 
noinial. Ilesides this, if the values h are approximale or, 
for some reason, the calculation of tlie value of the poly- 
nomial P. f/*) cannot be absohilely accurate, then, in 
fact, we got only an approximate value (.r;*)for an exact 
P (./••'). In that case tlie error of calculalion of i\^ {Pn)~'' 

I (•^*) — C^’*) 1 evalualed according to tlio gene- 

ral rules of calculation of an (*rror of a fund ion. 

laT us consider a Lagrange ])olynomial 7^,1 {x) 

II 

S fi^i {^)i example. Assume lhal wo have lo 

7=0 

calcnlale (.r*) for I ho giv(‘n values fi and thm’r errors 
'The values of (he Lagrange coefticienls /,• (.r) have be(‘n 
lahulaled for eqnispaccMl nodal points and we m,ay con- 
sider them lo be exact numbers since they have been ob- 
tained from the exact values of the nodal [)oints and the 
exact ./ *. Th(*refore we liave I In* following inequality 
for lh(‘ Lagrange polynomial: 

A, (/"„)< |/;(.r*)|. 

i--0 

In (he case when all are I he same and (Ujual lo f, wt* 
get 

A,(/" |/,(.v*)|. 

i-0 

The calculation error for other forms of an interpolaliiig 
polynomial can bo found in a similar fashion. 
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Example 3. On the interval [—1, 1] get a uniform estimate of 
the calculation error of tlio values of a Lagrange interpolating 
polynomial constructed for the function / - cos (jixl2) using the 
nodal points = — 1/2, = 0, arg = 1/2. 

A Since /o = /2 = = 0.707 ± 0.0002 and /i = 1 is an 

exact number, the required computational error has the form 


X* j 


) 

1 (1 ('009 

(••+. 4 - 

J .T* 

1 

2 

(~T- 

4 -) 

I ■ ' '1 Ft 

( 4 -+ 4 ) 

1 

* 2 


= 0.0004 [ I l+l (iM 4)®*|]* 


I^is easy to show that on the interval [—1, 1] the quantity 
A 2 (L 2 ) assumes the maximum value aljthe points a:* — 1 and, 

therefore, the required estimate is A 2 (L 2 ) ^ 0.0008. ^ 


7,8. Stirling and Bessel Interpolating Polynomials 

We shall first dwell on the problem of choosing inter- 
polation nodes for a fixed degree of a polynomial which is 
significant from the point of view' of an interpolation 
error. Let ns consider an expression for the remainder of 
the interpolating polynomial: 

n 

i)j n 

i=0 

Since an interpolation interval is usually not large, the 
derivative (:r) has a small range of variation. 

Consequently, the range of variation of the value of the 
error is defined, in the main, by the product 

71 

1 I 11 I x* — Xi |. 

This value is minimum if the nodes closest to x* are 
taken as the interpolation nodes. Thus, for an even degree 
n — 2k of the interpolating polynomial we must take 
a node closest to the point a:* and k nodes on the left 
and k nodes on the right of it, and for an odd degree 
w = 2/c + 1 we must take /c + 1 nodes on the left and 
/r H 1 nodes on the right of the point 

Let us now construct an interpolating polynomial for 
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tlie function / specified by its values h at the nodes Xi of 
a uniform net witli a step h. 

Let the point x* lie close to a certain node which we 
denote by Xq, We have to construct an interpolating poly- 
nomial of an oven degree. In accordance witli wliat we 
have said, we must take, as interpolation nodes, a net 
which is symmelric witli respect to the node .r„. 

. . ., • • *7 ‘^/m • • • 

We introduce a new variable t which serves to trans- 
fer the reference point to the point x^: 

. t = {x —Xn)/fi. (I) 

In this case - (x* — 

We construci an inlerpolating polynomial in the follow- 
ing form: 

M//.) a,-\ \ 

• • • ( 2 ^% ^ 1 ') • • • 

I (2) 

The unknown coefficients Oi can bo found from the condi' 
tions for coincidence of th(^ polynomial Pg/t 1^^^ func- 
tion / at the nodes x^. We note that relation (t) puts the 
quanlity L ^ i into correspondence with (‘ach of the 
nodes x^. For instance, t — i) is associated with the node 
;ind t = — 3 with the node x_^^. 

Thus, to find the coefficients Oi, we get a system of 
linear equations 

l^2h d '^0 fi ^ ('^) 

The slrucdure of this system is such that can be found 
directly from the first equation of system (3): 

f^' 2 h C^o) ~ ^0 ~ /o 

and the search for the other coefficients reduces to llie 
successive solution of systems of two equations in two 
unknowns: 

P>h (-^o 1 ^ /o + «i + ^ 

Pik (•'o” - /o “l + " /-)• 
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Jlence (see the designations in 7.7) = /J. 

Continuing this process, wc note tfiat at the ytli step 
the determinant of the system of equations relative to the 
coefheients a^j-^ and a^j has the form 


1 1/2 
— 1 1/2 



Consequently, all the coefficients Hi of polynomial (2) are 
un’qiicly defined by the system of equations (3) and, by 
virtue of the theorem on uniqueness, expression (2) is an 
interpolating polynomial for the function /. 

As a result of simple transformations we arrive at the 
following expressions for the coefficients: 

^0 “ /o> ^2j-t ~ M-Zo » ^ 2 } ■ /o^ (/ ^ ^ > 2 , . . . ). (-^l) 


Substituting the values of the coefficients obtained into 
exjiression (2), wc get Stirlinf^'s inlerpoLatin^ polunoniial 
which wer designate as *S' 2 /r 




(2k -1)! 




f2k 


Since Stirling’s polynomial is only a now foian of 
Lagrange’s interpolaling polynomial constniclcd wilh 
Ihe use of the nodes x-h, . . ., Xf^, it follows, by viitiie of 
formula (4) from 7.3, that the remainder relative to tin.* 
variable t can be represented as 


h 



and tlie estimate of tlie error of the approximale value 
P2U (.r) = 52, (/) (the error of the method) as 


^ 2h + l 

(2k+i)\ 


A,=-|/(a:)-5(0l 

. . . (i“— />;•’') 1, 


where | (j:) I. 


( 7 ) 



Gh. 7. Interpolation and Extrapolation 321 

Let now llie interpolation point x* lie between the no- 
des Xf^ and close to the point {x^ -f x^l2. We have to 
construct an interpolating polynomial of an odd degree. 
Then, as we pointed out above, the net, minimizing the 
error, is symmetric with respect to the point (xq x^I2, 
i.e. with respect to the point t = 1/2. 

Thus, on the net 

. . ., 3^— ft, • • *1 ^“1* ^Ot *^11 ^2* • • •» • • • 

relative to the variable t, defined by formula (1), we 
construct an interpolating polynomial in the form 

^2fe+i (^) ^2fe+i (^0+ ~ ^o + “rf 

. (<2 — (/C— 1)2)(/ — A:) 

The unknown coefficients bi can be found from the con- 
ditions of coincidence of the values of the polynomial 
/^2ft+i and the values of the function / at the nodes x,. 

Thus, to find the coefficients fc/, we have a system of 
linear equations 

P 2fc+l (•^0 ~ f i ~ • • -7 • • -7 

A- 4 - 1). (9) 

The structure of this system is such that its solution re 
duces to the successive solution of a system of two equa- 
tions in two unknowns: 

^2h + l (^o) “ ^0 ^ /o’ 

Hence b„ = n./,,*, = /',/ 2 . 

Continuing this process, we note that at the /th step 
the determinant of the system of equations relative to 
the coefficients and b^j_i is nonzero. It is easy to 

show this by analogy with what we did in constructing 
Stirling’s polynomial. Consequently, all the coefficients 
bi of polynomial (8) are uniquely defined by the system of 


21-OlOi 
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equations (9) and, by virtue of the theorem on uniqueness, 
polynomial (8) is interpolating for the function /. 

Simple transformations yield tlio following expressions 
for the coefficients: 

^2j-2 ...). (10) 

Sul)stituting (he values of the coefficients we have 
found into expression (8), we get fh^sseVs interpotaiin^ polp- 
iiOmial which we designate as 

H (f; = ji/,/2 +4f ('-t) + T ' 

• • • + w ^ 

f2h + i 

1 ). ( 11 ) 

Since Bessel’s polynomial is another form of representa- 
tion of Lagrange’s inlcrpolating polynomial constructed 
with the use of the nodes it follows, accord 

ing to formula (4) from 7.5, that the remainder relative 
to the variable t can be written as 


R 


2fe + l 


il) 

( 2 ^+ 2 )! 


n+i 

h2h^2 jy 

h- -k 


(f-i), 


^U+i) 


( 12 ) 


and the estimate of the error of the approximate value 
P 2 k+i {^) ~ (0 (ih® error of the method) as 

h-hl 

Jl It-il, (13) 

i=-h 

where = max 1 /(2'‘+2) (x) | . 

We have. thus considered two interpolating polynomials: 
Stirling’s polynomial which is used to construct a poly- 
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nomial of an even degree and is constructed witJi the use 
of an odd number of nodes and Jiossel’s polynomial which 
is used to construct a polynomial of an odd degree and is 
constructed with the use of an even number of nodes. 

Now if the degree of a polynomial is not rigidly lixed, 
i.e. may be even as well as odd, then it is expedient to 
use Stirling’s polynomial when 

1 I = I — :ro \/h^ 0.25, (l/i) 

i.e. when the interpolation point x* lies closer to the 
node Xq than to the middle point between the nodes. 
Bessel’s polynomial should be used when 

0.25 < ^*<0.75, (15) 

i.e. when the interpolation point x* lies closer to the mid- 
dle point between the nodes Xq and One of the condi- 
tions (1^‘) and (15) can also be ensured by the choice of 
the appropriate node as Xq. 


Example. Using an appropriate interpolating polynomial, cal- 
culate, at the point = 48.63° andx? -- 49.19° the values of the 
function / — sin x given as a table with a step of 1° (see Table 7.9), 
which contains the value h with four valid, in the narrow sense, 
digits. Estimate the error of ihc result. 

A Wc have established in Example 2 in 7.7 that the order of 
correctness of the table is 2. It is not advisable, therefore, to con- 
struct an interpolating polynomial of a degree higher than the 
second, i.e. it is expedient to construct either Stirling’s polynomial 
of the second degree or Bessel’s polynomial of the first degree. 

Since the point = 48.63 lies closer to the middle p^)’nt be- 
tween the nodes of 48° and 49°, we must take the node of 48'- as 
when calculating sin x*, and make use of Bessel’s polynomial. 
Then = (xf — Xq) ~ 0.63. The point xj — 49.19° lies 

close to the node of 49° and, therefore, we must take the nodal 
point Xq -= 49° as the central node when calculating sin xj and make 
use of Stirling’s polynomial. Then t? — (x^ — Xq) = 0.19. 

Thus, employing our previous statements, from formulas (11) 
and (5) and also from the data given in Table 7.9, we have 


B. ,0.63)= 3,, 

Z 1 ! 

■Sa (0.19) ==(1.7547+ . 0.19 


+ 


— 0.0003 
21 


•0.19a = 0.7568809. 


21 * 
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We shall estimate now the errors of the method using formu- 
las (13) and (7) respectively: 

Taking into account the errors of the values of the function and 
of its finite differences given in Table 7.9, we get the values of the 
computational errors: 

A* (^i) = 0.5.10-^ + 1.10-4.0.13 - 0.63.10-4, 

A* (S^) = 0.5.10-4 + 1.10-4.0.19 + 1.10-4.0.192 
= 0.73.10-4. 

When rounding off the values Bi (0.63) and (0.19) to four deci 
mal digits, we get the following rounding errors: (^,) — 

0.08.10-4 and A 3 (5,) = 0.11 10-4. 

Combining all the errors we have found, we obtain sin 48. 63^^ 
0.7509 zb 0.0001, sin 49.19° = 0.7569 zb 0.0001. A 

Remark. In some cases, to minimize the total error, it 
is expedient to use an interpolating polynomial whoso 
degree is higher than the order of correctness of the 
table of finite differences. This can be explained as 
follows. Naturally, the computing error increases with 
an increase in the degree of a polynomial. At the same 
time, the decrease in the error of the method can bo so 
sharp that it involves a decrease in the total error. 

7.9. Newton^s First and Second Interpolating 
Polynomials 

If the interpolation point x* is at the beginning or the 
end of the table, then it is not always possible to choo.se 
a sufficient number of nodes to the left and to the right 
of a:* to construct the necessary finite differences. In that 
case we use special forms of an interpolating polynomial. 

Let the point x* lie close to the first node of the net 
Xq, arj, . . ., ajft, . . . . We consider a variable t defined by 
relation (1) from 7.8 and construct an interpolating poly- 
nomial in the following form: 

Ph(x)^Pu (Xo + th) 

= flo + + -g- < - 1) + • • • + IT ^ • • • < 

( 1 ) 
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We find the unknown coefficients at from the conditions 
of coincidence of the polynomial and the function / at 
the nodes Xi, Recall that each node Xi is associated with 
the quantity t = i. Thus, to find the coefficients a^, we 
get a system of linear equations 

Pft {Xo + ih) = fi {i = 0, 1 k). (2) 

Tfic structure of this system is such that a^^ can be found 
directly from the first equation of system (2), can be 
found from the second equation for already found and 
so on. Indeed, setting i — 0, we find, from the first equa- 
tion of system (2), that 

^ k (-^o) “ “ /oi 

from the second equation we find, for / — 1, that 


/o + “jf * ^ /i» — ^/o- 

Continuing this process, we get, as a result of simple 
transformations, the following expressions for the coeffi- 
cients: 

“o = /«. ai = AVo {i = i, 2, . . k). (3) 


Substituting the values of the coefficients we have found 
into relation (1), we get Newtons first interpolating 
polynomial which we designate as N\: 

...{t-k^\). (4) 

By virtue of formula (4) from 7.5, we can represent the 
remainder relative to the variable t in the form 


arid the estimato of the error of the approximation NI (t) 
(the error of tlie method) in the form 

A, ^ I / {x)-N\ (t) I itit-i)...(t-k)\, 

where max 

[Xo. 
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Let now the point x* lie close to the last node of the 
net . . . x-h, . . x-i, Xq, Again using the variable t, 
defined by relation (1) from 7.8, we construct an interpo- 
lating polynomial for this net in the form 

Ph i^) ^ Ph + th) 

= ®o "f" "ij" ^ ^ + 1) + • • • 4" t . . . — 1). 

( 7 ) 

The unknown coefficients at can be found from the con- 
ditions of coincidence of the polynomial Ph and I he func- 
tion / at the nodes Xi. Note that the node x-i is asso- 
ciated with the value t = — i. Thus we get a syslefn of 
linear equations 

P^(x„-ih) ^ (i ^0, l, . . k) (8) 

to obtain the coefficients The structure of this system 
is such that flo be found directly from the first equa- 
tion of system (8), from the second equation for a„ 
already found and so on. Indeed, setting i — 0, we iind 
from the first equation of system (8) tliat 

(^o) " “ /() 

and from-the second equation, for i — 1, wo liave 

Ph (^0— ^ /o + -jf 1 "" /-I’ ®1 - 

Continuing this process, we get, as a resull of simple 
transformations, the following expressions for the coefh- 
cients: 

«o-/o, «i-V7o (''=1.2 k). (!)) 

Substituting the values of the coefficients we have found 
into relation (7), we get Newton s second interpolating 
polynomial which we designate as 

1 )+ 

... + -^f(^+l)...(/ + /c-l) (10) 
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with the remainder 


...{i + k), (11) 

^ ^ ' ^o) » 


and the estimate of the approximation error 

A, I / (X) - (0 I M (< + 1) • • . (< + /^) I . 

(12) 

whore max | (j;) | . 

*o] 

Formulas (4) and (10) are often called Newton's inter- 
polation jorrnulas for the forward and backward interpola- 
tion respectively. 

Example. Set up appropriate interpolatiiijr polynomials ami 
calculate, at the points = 0.63 and .r* — 1.35, the values of the 
riiiictioii / — ^iven as a table which coutuins the values /,• with 
four valid, in the broad sense, digits: 


X 

0.50 

0.75 

1.00 

1.25 

1.50 

f 

1.732 

2.280 

3.(K» 

3.1)48 

5.106 


Evaluate the error of the result. 

A We put in this table the values of finite differences writing 
the values of the errors of the corresponding finite differences in the 
last row: 

Table 7.10 
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Since the fourth finite difference coincides with its error, it is 
not expedient from the point of view of the calculation error, to 
approximate the given function by a polynomial of a degree higher 
than the third. 

Furthermore, since 2 ? = 0.63 is at the beginning of the table 
and x% = 1.35 is at its end, it follows that we must use Newton's 
first interpolating polynomial to calculate Newton's 

second interpolating polynomial to calculate /$ = 3^ 

Thus, setting a:® = 0.5, we calculate = (xj — x^)//^ = 
(0.63— 0.5)/0.25 = 0.52. Substituting the value of t1[ obtained into 
expression (41 for Newton's first interpolating polynomial and using 
the values 01 finite differences given in Table 7.10, we obtain 

Nl (0.52) = 1.732 0.52. (-0.48) 

+ .^^=^•0.52 ( - 0.48) ( - 1 .48) - 1 .9989420. 

Similarly, setting Xq = 1.50, we calculate t% ^ (1.35— 
1.50)/0.25 == — 0.60 and, using expression (10) for Newton’s 
second interpolating polynomial, we obtain 

^“(-0.(ii)) = 5.196+ •(-0.(»))+— 1^*** .( -0.t)0).0.4» 

-f- . ( _ 0.60) . 0.40. 1 .40 = 4 .4071 68. 

Let us use formulas (6) and (12) to estimate the error of the 
method: 

Ai (N\) < ^ - . 0.25«.0.52.0.48.1.48.2.48 = 0.0009, 

Ai (Ar3“)<-^^:^^p^-0.25‘.0.60.0.40. 1.40.2.40 = 0.001. 

Taking into account the values of the errors jh given in Ta- 
ble 7.10, we evaluate the computational errors: 

A* (AtJ) < 0.001 + 0.0011 + 0.0005 + 0.0005 = 0.0031, 

A* (ATJ^) < 0.001 + 0.0012 + 0.0005 + 0.0005 =- 0.0032. 

Rounding oil the values n\ (0.52) and (— 0.60) to four decimal 
digits, we get the following rounding errors: 

As (JVj) = 0.06 . 10-3, A, (JVj *) = 0.2 • 10-3. 

Combining all the errors found, we finally have 33.*3 = 1.999 ± 
0.005, 3».“ =*= 4.407 ± 0.005. A 
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7. 10, Divided Differences 


In the preceding sections we considered various forms of 
interpolating polynomial for a uniform net of nodes. The 
coeflicients of the polynomials constructed were found 
with the aid of finite differences. In this section we again 
consider the case when the values of a function are given 
at nonequispaced nodes. In such a case, instead of finite 
differences we consider divided differences which are, in 
a sense, an analogue of the concept of a derivative and 
are defined as follows. 

Assume that the function y = f (x) is defined by its 
values y^, = -= f = f (xj), . . ., y^ ^ fj,= 

f (x^), ... at tlie nodes Xi of an arbitrary net The 
divided differences of order zero f (./ J coincide witli the 
values of the function at the points Relations of the 
form 


/ ('^r » i-l) ~ 


/l-/» 
xi — x,, ’ 

/i-t-l li 
•^i + 1 


*^2 1 


are known as the first divided differences. Relations of the 
form 


/ (*^o» 

/ (Xj, 


j, \ J-a) — /(j:o, ri) 

X2 — J’o 

.. \ /(^2, J-s) — /(^i, -^ 2 ) 

**3; — ~ :: 


/ (•^1 » ^i+l » ^2) 


^1+2 


are the second divided differences. In the general case, the 
kth divided difference can be found with the use of the 
(/f--l)th divided difference from the formula 


f {Xiy Xl+^^ • * >9 + 

_ f (^i+h •••1 ^i+h) /(^ii /^ \ 

~ XUh—^i ‘ ' ' 

Other designations can be used for divided differences 
(difference quotients): 

/ (Xii + • • M ^i + h) = + • • *1 
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ft is convenient to tabulate divided differences by 
analogy with what was done for central linite differences: 

Table 7.11 



n = t(xi) 

[Xi, ^/ + ll 

[^£» ^i+it 

^1+2] 

1 

'^i+ 2 i ^i+3» 

^i+4l 

^0 

Uo 







[^0. ^l\ 




Xi 

Ui 

■■ 






[Xu X 2 ] 


[.7*0, X^y 

^2» ^3] 


a-2 

y 2 


H 

im 

n 



• [‘^21 ^3! 


^3, ^4l 


^3 

Us 


[^2i ‘^3» ^4! 

1 




^4] 




X 4 , 

y^ 






Example 1. Compile a table of divided differences for the func- 
tion y = f (x) given as the following tabic: 


X 

0 

1 

5 

10 

y 

10 

2 -)^ 

100 

1100 


A Using the definition, we find the first divided differences 


l^Oi ^il — 

[ll, X2] = 

X 3 ] = 


yi—vo 

Xi Xq 

y^—vi 

ya — 1/2 

^3 ^2 


20-10 


= 10 . 


1—0 
100-20 80 
5_1 "" 4 


1100 — 100 1000 


10-5 


= 200 . 
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In a similar way we find the second divided differences: 
r-, ^ _ 1 ^2! ^ll 20 10 

[Xo, Xu Xal- — — - —5110 


*2 — ^0 ^ 

r_ _ _ I [j 72» [^i» ^ 2 ! 200 20 

"^2* ^aJ- ~ 10-1 

The third divided difference 


[^o» ^i» ^2» ^3] — 


l^it ^2* ^al l^o» ^2! 20 2 


^3—^0 

Wo tabulate the results of calculations: 


f*i» ^i+il f^i* ^i+1* *i+2^ *i+l» *i+2’ ^t+a^ 


10 1100 


Here are some properties of divided differences. 
r\ Diuided differences of all orders are linear combina- 
tions of the values f I = f (xt), namely^ the following formula 


holds true: f {x^, x^)—^ — . (2) 

i=0 [j (Xi—Xj) 

}=0 

5-¥=i 

□ For k—0 we gel. an identity /(:ro) = /o» A=1 

we have f{xQ, ^i) ^ ^ ♦ And this is the defini- 

Xq Xi 

lion of the divided difference f(xQyXi), 

We sliaJJ continue with the proof by induction. Assume 
that equality ( 2 ) is valid for all /c^ n. Then 

//^ \ / (^o» •••» ^n) f (^h •••» ^n+l) 

/ [XQy . . . , J'Yi + iJ — - 


s 


71 

1 ‘ 

II 

\ 

j-=Q 


fi S) fi 

ZJ 71+ 1 

(Xl-Xj) 1 ] {Xi-Xj) 
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n 

/o L V fi 

n+l ' ^ n+\ 

[I (Xa — Xj) i=l II (Xi — Xf) 

j=^i 



fi 


n+\ 

II {Xi-Xj) 
j^O 
3¥=i 


/n+l 


J[ (^n+1 ^j) 

i=o 


Thub equality (2) holds true for A: — -f 1 as well. ■ 
2"^. A diuided difference is a symmetric function of its 
arguments^ i,e. it does not change upon their permutation, 
□ Upon any permutation of the arguments Xk, 

the corresponding terms on the right-hand side of relation 
(2) only change places but the sum evidently remains un- 
changed. Consequently, the left-hand side of relation (2) 
does not change either, i.e. / • • •» ^k)- H 

3''. A divided difference satisfies the equality 

{af -{- bg) Xk) = af . . ., Xk) 

-f bf (xo, . . ., Xft), (3) 

where a and b are constants. 

This immediately follows from relation (2) since its 
right-hand side is linear with respect to //. 

The next property expresses the connection between the 
divided difference / (xy, . . ., x^) and the derivative /^(x). 

If the nodes Xy, . . . , X)^ belong to the interval [a, b] 
and the function f (x) has a continuous kth-order derivative 
on [a, fc], then there is a point g g (a, b) such that 

/(Xo, = (4) 


This property yields a simple corollary. Let /(x) = aoX^4- 
+ • • • + be a polynomial of degree k. Then, 
evidently, /<'*> (x) == Ookl and relation (4) yields the fol- 
lowing value for the divided difference: 

/(^o» = = (5) 

Ilf 

Thus for any polynomial of degree k the Ath-order divid- 
ed differences are equal to a constant quantity, which is 
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the coefficient in the leading power of the polynomial. 
Divided differences of higher orders (liiglier than k) are 
evidently zero. 

Example 2. Let us verify the validity of Property using 
four values of the function y = / (^)» i e. ui I (t^) (/ — 0, 1, 2, 3). 
We find the first divided differences: 






.r, -.Tt 


and then seek the second divided differences: 

^2 ^ 




Vo 


(To — Xi) (3-0 — Xj) 

Ml 


'h 


(Xj— Xo) (Xi— Xj) 


/(X,, Xj, Xs)-—^-— ( 
•^l — ^3 ' 


yi—y2 

Xi — T^ 


(•^2"-^o) (-^2 --^l) 

y-z — ih \ 

To- I 


Vi 


(Xi— .Tg) (.Ti—J-g) 
J ^2 


//3 


(•^2 - -^ i ) (^2 - ( ^ I ) ( » a - -^2) 


This is in full accord with Properly 1'’. We can show in a similar 
way that the third divided difference 


/ (‘^0? •^2» ‘^.l) ' 


.Vo 


— 3:2) (.T„ -Tg) 

+ U 

('^1 •^3) 

_| V2 

— ^0) (^2 ~ ‘^i) (-^2 •^:i) 

I .V.1 


(•^3 — •’’o) (^3 — 3^1) (-^3 - -^2) * 

We calculate the third finite difference using the values of the 
function and the argument given in Example 1: 

[3*01 3 ?!, 3*3! ~ ' 


(_1)(_5)(-10) ' 
lOd , 1100 1 5 

10. 9-5 5 9 


l.(-4)( -9) 
22 


-1 + - 


1 . 8 . 


' 5.4.( — 5) ‘ 10.9.5 5 ' 9 '9 

This coincides with the value obtained in Example 1. 

Example 3. Let us verify now the validity of Property 2^ for 
the function y f (x). We shall show, for instance, that / (j:o, 

3 ^ 2 ) ~ / (3?li 3 :q, x^. 
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Indeed, according to ilio definition of a divided difference we 
have 




yi 


!/o 


(xi — xo) (x^ — x^) 

1 ^2 


(arQ {xq x^ 


Wo have obtained the same result as in Example 2 (with a cJiange 
in the sequence of terms). 

Example 4. We shall illustrate Property 3°. Together with the 
function y — f (x) given in Example 2 we shall consider a function 
z = g (x) and its values — g (xi) (i = 0, 1, 2, 3) specified at tlie 
same nodes as z/^. We set up a linear combination u (j:) = af {x) 1- 
bg (i), where a and b are constants. Lot us now calculate 
ii (tq, Xi, X 2 )- As in Example 2 we find that 


U (.To, Xi, X2) 


ayp + bzQ 
(^ 0 —^ 1 ) (^0 — ^ 2 ) 


ayi -I- 

(xi J^o) (.Tl Tg) 


I ay2-\~bz2 

(X2 — Xo)(X2 — Xi) 

Grouping separately the first and the second summands of each of 
the tnree terms of the sum, we obtain 


u {xq, Xi, X 2 ) = af {Xq, xi, X 2 ) + bg (xo, Xj, x.^), 
and this is what we wished to prove. 


7.11. Newton’s Interpolating Polynomial 
for an Arbitrary Net of Nodes 

Using Lagrange’s form, wo roprosont Iho intorpolal.ing 
polynomial as 

Lo M -1- (^] W — ^-0 W) 1- • • • + CO- 


Here Lq (jt) = / (xq), Lu K^) = 1, • • •» n) are inter- 

polating polynomials in Lcagrangc’s form conslrucled 
with the use of the nodes Xq, Xi, . , x^. We consider the 

differences 


h 



i=0 


(X — X;)( 0 ; (Xi) 


2 A 


i=0 


(a: — i^i) 


="S A 


i=0 




(®h) 


(a;) 


h 


2 


fi 

(o; (xi) • 
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Thus, using formula (2) from 7.10, we obtain 

^h-\ “ (•^) / ( 1 ) 

and the interpolating polynomial assumes the form 

Nn {x) = /o -\- (x — Xq) / {Xn , X,) + . . . t- — a-o) 

... (x — x„_i) / (Xo, . . ., x„). (2) 


This form is known as Newtons interpolating polynomial 
with divided differences. 

The expression for the error has evidently the same form 
as in the case of Lagrange’s polynomial [see formulas (8) 
and (9) from 7.5] 

Example 1. Using tho nodes a:© — 0, xi = 1/3, ~ 1, construct 

Newton’s interpolating polynomial for the function / - ^ sin (ji.r/2). 

A Taking into account that /<, - 0, h - 0.5, /g ~ 1» we set 
up the necessary divided differences: 






/ (^ 1 , ^i) 



3 

4 » 


3 3 


/ (^o» ^1, 


2 4 

0 — 1 



Suhsli luting the values obtained into formula (2), we have, for 
« ^ 2, the following polynomial: 


This polynomial must evidently be idenlical to Lagrange’s polyno- 
mial constructed in Example 1 in 7.C. The reader is invited to 
prove this independently. ^ 


Note that in form (2) of interpolating polynomial a unique 
condition is imposed on the nodes xi, tlieir noncoin- 
cidence. Therefore, the nodes may be enumerated arbitra- 
rily. For instance, the index “0” often deimtes the last 
node in the table, its last but one node and so on. 
In this case polynomial (2) assumes the form 


(^) — /o “k ^o)f (^0» ^-l) 

+ . . . + (x — Xo) . . . (x— X_„ + i)/(Xo, . . ., X.n) (3) 
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and is called Newton's polynomial for backward inerpola- 
tion. 

To illustrate what we have stated, we shall solve Example 1 for 
Xq — 1, = 1/3, a:. a = 0. From formula (3) we obtain 

Note that the necessary divided differences have been taken 
from Example 1, the property of their symmetry being used with 
respect to their arguments. 

The comparison of Lagrange’s and Newton’s forms for 
an interpolating polynomial makes it possible to recom- 
mend the use of representation in Lagrange’s form, first, 
in theoretical research, say, to study the problem of 
convergence of Pn (/, to / as w cx), second, to inter- 
polate several functions on the same net of nodal points 
since in this case Lagrange’s multipliers li can be calculat- 
ed once and then used to interpolate all the functions. 

Representation in Newton’s form proves to be the most 
convenient in practical computations. Indeed, the num- 
ber of nodal points to be used and the degree of the 
interpolating polynomial are often not predetermined and 
when we pass from n nodes to + 1 nodes in Newton’s 
form we add only one term which has the sense of a cor- 
rection of the value already calculated, whereas in 
Lagrange’s form an addition of one more term must be 
followed by a complete recalculation of the result ob- 
tained. In addition, in computations interpolation is usual- 
ly carried out on a small interval of length h <C I and the 
summands in Newton’s form are of the order of /i®, feS 
. . ., i.e. are arranged in a decreasing order, which 
is convenient when the accuracy of the result of inter- 
polation is determined. 

7.12. Practical Interpolation in Tables 

Linear or quadratic interpolation is usually used when 
interpolation is carried out in tables. 

In the case of linear interpolation the value of a func- 
tion at a point different from the interpolation nodes is 
found from two known values of the tabulated function 
yi = f (xj), j/i+i = / {Xi+i) at the interpolation nodes xi 
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and between which the value of the required argu- 
ment X lies. 

Lagrange’s interpolation formula for linear interpola- 
tion assumes the form 


(^) = Vi 






X — Xi 


» 


and Newton’s hrst interpolation formula assumes the form 


N,{x) 




h 




where Aij; —■ — yi is the first finite difference at the 

point Xj and h — Xj is the stepsize of interpola- 

tion. 

Thus, to use Newtdn’s formula to obtain an approxi- 
mate value of the function y (.r), it is sufficient to add a cor- 
rection equal to Az// (x — Xf) h-^ to the tabulated value z//. 

Example 1. Find out how many dogroos are there in the radian 
measure 

A We use the table 


lladians 

Decrees 

0.22 

12.6«)5 

23 

13.178 

24 

13.751 


To carry out a linear interpolation, it is suliicienl to consider the 
data in the lirst two rows. We set up a tabular difference 

Ay/ y/+i — yi = 13.178 — 12.005 = 0.573. 

The stepsize of the table h 0.01, x — Xj - 0.222 — 0.220 — 
0.002. We calculate the correction 


Ay/ 

h 


(x — Xi) -- 


n.573 

0.U1 


•n.no2 -0.1146 


and add it to the tabular value: 


// - 12.605 + 0.1146 - 12.7106. 

Let us verify the error of the value obtained. Using formula (8) 
from 7.5, we have the following value for the error of the method: 

M 

Ai - I (0.222 — 0.22) (0.222 - 0.23) | . 

21 


22-0104 
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Since the function being interpolated is ^ = (180 x/jt), it fol- 
lows that Af 2 = 0 and Ai = 0. 

Let us find the computing error, taking into account that the 
error of the initial data constitutes 0.0005; 

Ag = 0.0005 + • 0.002 = 0.0007. 

Rounding off the value ij (0.222) to three decimal digits, we get 
Aj = 0.0004. 

Summing up all the errors found, we finally have ^(0.222) = 
12.720 ± 0.0011. 4 

In the case of a quadratic interpolation we use three 
values of the tabulated function yo = 

/ (^o)» = / (^i)- The interpolating polynomial is 

constructed either in the form of Lagrange (for nonequi- 
spaced nodes) or in Newton’s form when the interpolation 
point is closer to x^i or to than to x^^ or in Stirling’s 
form when the interpolation point is close to the node j-q. 

Example 2. Construct Newton’s^, interpolating polynomial for the 
function y = In x using its tabulated values 


X 

2 , 

3 

5 

y 

and obtain a uniform 

0.6931 1 
estimate ol 

1.0986 

i the error 

1.6094 

on the interval [2, 5]. 


A First of all we seek divided differences: 


/(2, 3)= **‘*^^^^ =0.4055, 

,,, rx 1.6094—1.0986 ,, 

/ (3, 5) ^ — =0.2554, 


/(2, 3, 5) = 


5 — 3 

0.2554— 0.4<)55 
5-2 


-0.0500. 


Substituting the values obtained into formula (2) from 7.14, 
we find, for n = 2, that 

TVa (^) = 0.6931 + 0.4055 (x — 2) - 0.0500 (x - 2) (x - 3), 
Using estimate (8) from 7.5, we have for the error of the method 

Ai — - max |(ir— 2) (a: — 3) (x — 5)1 . 

[ 2 . 5 ] 

Next we find that 


Ma= maxj 
[ 2 . 


Thus Ai = 0.1. 


max |(a; — 2) (x — 3) (j: — 5)1 ^2.2. 
[ 2 . 5 ] 



Ch. 7. Interpolation and Extrapolation 


339 


The computing error is evidently negligibly small as compared 
to the error ol the method. Therefore the maximum possible error 
of interpolation is 0.1. ^ 


7.13. Aitken’s Iterated Interpolation 

It is expedient to employ Aitken’s iterated interpolation when it 
is not necessary to obtain an approximate analytic expression for 
the function / (a:), given in a tabular form, but the only problem is 
to find the value of this function at a point x* different from the 
interpolation nodes. The gist of the method is a successive linear 
interpolation. The process of computing / (x*) is the following. We 
enumerate all the interpolation nodes, say, in the order of their 
receding from x* and compile the following table. 


Table 7.12 


^4 

Pt 

m 

i>»« 

p0l24 

Xg 

PI 

pO.2 

pOI2 

pot 23 

Xq 

PI 

pl.O 

poi:. 



PI 

pi .3 



^•3 

P% 





Here 






X — Xj 
Xi—Xj 


Vh 


X — Xi 


1 

Xj — Xi 


T~Ti PI 
X — X^ Pj 


is an interpolating polynomial of a degree not higher than the 
first, constructed with trie use of the nodal points x,- and xj. 


PV’' 


1 

Xfi—Xi 


X-Xi py 
X — X^t p{^ 


is an interpolating polynomial of a degree not higher than the second 
constructed with the use of the nodal points x^, xj, x^. Continuing 


22 * 
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this process, we construct a polynomial 


PV 

7} 


..hm 





(1) 


We shall show that if (x) and (i) are intcrpolat- 

ing polynomials constructed with the use oi the nodal points 
xj, . . xh and xj, . . x;,, x^ respectively, then pj/- (a:) is 

an interpolating polynomial constructed with the use of the nodal 
points xi, xj, . . ., .Tft, Xjn‘ 

Indeed, first, (x) is a polynomial of a degree not higher 

than n. This can be seen from the construction of formula (1). 
Second, at all nodal points the polynomial Pjj (j::) as- 
sumes the corresponding value: 


p^j 


. .km 


i^i)^ 


— ft 

^ i 


-fi 


pij ■ • • (x„) = 

pij .. .km _ ({-^p -^i) fp i^'Tp — Xjn) f p) f j,. 

. *^m i 


Calculating successively the values Pjl • (a:*) from formula 

(1), we take them to be the successive approximations of / (a*). The 
computing process is terminated when the absolute value of the 
difference of two successive approximations becomes sufficiently 
small. 

Example 1. At the point a:* — 6 calculate, with an accuracy of 
e = 0.05, the value of the function f = \n x given as a table 


x 

1 

.2 1 

4 

5 

8 

10 

f 

0.00 

i).69 

1.39 

1.61 

2.08 

2.3) 


A We enumerate the nodes as follows: a-o ~ 5, xi ~ 8, a *2 ~ 4, 
Xg = 10, ^4 — 2, a:g — 1. Using formula (1), we calculate the values 
of the interpolating polynomials ((>): 


Py = 

po 2 - 


1 

8-5 

1 

5-4 


6 — 5 1.61 
6 — 8 2.08 
6 — 4 1.39 
6 — 5 1.61 


-1.77, 

-1.83, 


PS 12^ 


1 

8-4 


6-4 1.83 
6—8 1.77 


-1.80. 


Since — PS I — < 0.05, we terminate the calculations 

and set In 6 = 1.80 dz 0.03. 4 
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Example 2. Using Aitken’s scheme, calculate, with an accuracy 
of 0.5- lO"'*, the value of sin 0.674 for the function y = sin x, 
given as a table 


Xq --..-U .66 

xi = n.67 

^^2 = 0 .68 

I/O -=6.61312 

1/1- 0.62099 

2/2 -=6.62879 


A According to formula (1) we have 


/T (0.674)- 


0.674 — 0.68 0.61312 
0.674 — 0.67 0.62090 


0.67-0.66 


= 0.625730, 


pi2_^ 

7^012 


1 

0.68 — 0.67 
1 

0 . 68 — 0.66 


0.674—0.67 0.62099 
0.674— (K68 0.625643 


-.0.625613, 


0.674 — 0.66 0.625730 
0.674 — 0.68 0.625643 


= 0.625676. 


Consequently, sin 0.674 0.62568 + 0.00004. A 


7.14. '‘OpHipal -Interval” Interpolation 

Let us cojisiflor again the estimate of the error expressed 
by rorrnula (8) from 7.5. We assume now that tliere are 
no restrictions in tlie choice of the net A,^. We pose a prob- 
lem of the best choice of interpolation nodes. Proceeding 
from the estimate (8) from 7.5, we lind that the best 
interpolation nodes for the class of functions 6”^^^ ([a, h]) 
being considered are Xi for wliich the expression 
max I (o„ (.i) I is minimum. The determination of 

[nji] 

these nodes aclually reduces to ihiding the roots of a poly- 
nomial which lias the smallest deviation from zero the 
interval [a, b\. As is known from the theory of functions, 
such a polynomial is generated by Chebysheu's polyno- 
mials of the first kind which are dehned by the following 
recurrence formulas: 

X, = 2xT, - n, > 0. (1) 

Lot us consider the principal proporlios of Chebyshev’s poly- 
nomials. 

1 ^. The leading term of the polynomial results from the 

leading term of the polynomial {n = 1 , 2 , . . .) multiplied hy2x. 

□ We have 

— 2x-x — 1 = 2x^ — 1 , 
fg — 2x (2x^ ^ i) — X — 4x® — Sx. 
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Therefore the leading term of the polynomial is equal to 

2 n^n+i^ The general form of the polynomial is 

2°. All the polynomials (x) are even functions and T 2 n+i {^) 
are odd functions. 

□ For n =? 0 this is obvious. Let this be valid for a certain n. 

Then the function 2xT2n+i W is even and, hence, ~=-' 

2^^2n+i (^) ^271 (x) is also an even function. Furthermore, the 

function 2xT2n+2 (^) is odd and therefore ^’2^+3 (a:) = 2a:7’2„+2 (x)— 
T 271^1 (^) is also an odd function. ■ 

3 . If X ^ I — 1, 1], then Chebyshev's polynomials have the fol- 
lowing t'xplicit expression: 

^ 12+1 W = cos l(n + 1) arccos x], — 1. (2) 

□ We shall prove that the right-hand side of relation (2) satis- 
fies definition (1) of Chebyshev’s polynomials. Indeed, 

{cos [(n + f) arccos a:]}n=«i = l = 7’o» 

{cos [(n 4- 1 ) arccos = a? = T^i . 

To prove that the recurrence formula holds true, wo consider 
the obvious trigonometric relation 

cos (m -f 1) 0 = 2 cos 0 cos n0 — cos (n — 1) 0. 

Setting 0 = arccos x, whence it follows that x — cos 0, we get 
cos l(n + 1) arccos x] = 2x cos [n arccos x] — cos [(ri — 1) arc- 
cos x]. ■ 

4°. On the interval [ — 1,11 the polynomials (x) have n \ 
distinct roots: 

XU = cos 2{ri+l) ” (* = '^ 1 . •••.'»)• ( 3 ) 

□ Using expression (2), wo get the following equation for deter- 
mining the roots of the polynomial +i {x): 

(n-f-l) arccos = 4- jiA: (fc = 0, 1, ..., n). 

Solving this equation for xh, we arrive at relation (3). ■ 

5®. On the interval [ — 1, 1] the inequality 

I Wl^i 

holds true. 

This follows immediately from relation (2). 

From the same relation (2) we find all points at which the 
polynomial (x) attains its extremal values ± 1. For this to 
occur, it is necessary that 

(n 4- 1) arccos XJf^ = nm (m — 0 , 1, . . ., n 1) 
and, conseque^itly, 

m 

x„, = cos-^q-^n (m = 0, 1, n+1). (5) 



343 


Gh. 7. Interpolation and Extrapolation 


Substituting these values into relation (2), we obtain 

^n+i i^m) — COS mn = (—1)’”. (^1) 

This means that the points, at which = 1 and 1, 

alternate beginning with xq = 1, where (1) -= 1. Note once 

again that inequality (4) holds true not for all j:. H | ^ | > 1, then 
arccos x does not exist on the set of real numbers. 

Lot us consider now polynomials 

= . (7) 

Tliese are polynomials which have the smallest deviation 
from zero on the interval [ — 1, 11. This fact is substanti- 
ated by the following theorem. 

Theorem. Let (^) be a polynomial oj degree n \ 

with the leading coefficient equal to 1 . Then 

max I P„+, (x) I > max | f„+, (x) | = 2-”. (8) 

[- 1 . 1 ] [- 1 . 1 ] 


□ We assume that inequality (8) does not hold true. Then the 
polynoFnial Qfi, (x) = whoso degree is not higher 

than n at all n + 2 extremal points of the polynomial 
would coincide with the latter polynomial in sign and, consequently, 
would alternately assume positive and negative values at these 
points. Therefore QJ^ (x) must have n + 1 distinct roots, and this 
is impossible for a polynomial of a degree not higher than n. The 
contradiction obtained proves the theorem. ■ 

Every interval [a, /d can bo obtained from the interval [—1, 1] 
by means of a linear change of variables 


2 


b — a 


(9) 


Til this case the polynomial 7’n+i W is transformed into a poly- 
nomial Tn+i I — I with a leading cocfriciont ^ • 

Consequently, 

(*) = (b ) d") 

is a polynomial with a leading coefficient 1 which has the smallest 
deviation from zero on the interval [a, 6], and the following in- 
equality holds true for any polynomial P„+i (x) of degree /i -f 1 
with a leading coefficient 1: 

max |P„+i(*)| > max =2-^ {'^T^) ^ * 

[o. [0.6]' ' \ -i / 


( 11 ) 
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By virtuejof the linear change of variables (9), the roots of the 
polynomial (x) have the form 


Xh = 


6 + a 


b—a 2k+i 

■ cos 


2 r 2 2(n + l) 

and the extremal points have the form 


JX n), (12) 


h + a 


(m = 0, 1, n + \). (i3) 


We shall return now to the problem of the minimization 
of the error of interpolation on the interval [a, 61 for 
an arbitrary net on the class of n + 1 times continuously 
differentiable functions which satisfy condition (7) 
from 7.5. We shall designate this class of functions as 
C^+i {Mn+i Idj 61). By virtue of formula (8) from 7.5, to 
solve this problem we must minimize the quantity 
max I (x) |. Since ( 0 ,^ (:r) is a polynomial of 

[a.fe] 

degree n -f- 1 with a leading coefficient 1, it is evidejit 
that the quantity max | (x) ( attains its rnini- 

la.6i 

mum value for Ghebyshev’s polynomials (x). 

Consequently, we must take as the interpolation nodes 
the points defined by expression (12). In this case 


max I (On (oj) I = max 1 ’ (a;) 1 = 2"“ , (14) 

la. 6] la. 6]' ' V <2 / 

and estimate (8J from 7.5 assumes the form 




(« + l)! 


2-u 




(15) 


This estimate cannot be improved since we shall have 
an equality sign in it if we choose the polynomial of de- 
gree n + 1 


/(X): 




(« + l)! 


x'‘^‘ + a„x'* + 


as the function / (x) and the points xj, defined by expres- 
sion (12) as interpolation nodes. 


Example 1 . On the interval | — 1,1] obtain a uniform (estimate of 
the deviation (if the function I (x) — i — cos (nx/2) from its inter- 
polating polynomial constructed with the use of Ghehyshev’s nodes 
(3) for n = 2, 3, 4. 
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A Note first of all that for the function in question on the 
given interval we have b — a — 2. Therefore, by 

virtue of estimate (15), we have 


n~2^ 

/A — 3, Ai ^ 
Ai — 4, 


/ Jl ' 

1" 

1 

/ ^ ^ 

It, 

1 

3! 

( 2 j 

/ n 1 


1 



1 

4! 

1 2 / 



1 

( 1 ^ 

Itj 


5! 

1 2 / 


We recommend the reader to compare the solution obtained with 
the solution of Example 1 from 7.5. ^ 


7.15. Interpolation with Multiple Nodes 

Up till now we considered a problem in which the inter- 
polation pai , ’nriiers, i.e. the coeflicients of the ijiterpolat- 
ing polynomial, were dehned only by the values of the 
interpolated function. This problem is often called an 
Interpolation problem in the sejise of Lagrange and the pro- 
cess of constructing the interpolating polynomial, iMgran- 
ge's process. 

We shall consider now a more extensive problem, that 
of interpolation with respect to the values of a function 
and its derivatives or, as they also say, the problem of 
mu Iti pie interpolation . 

Assume that the values /, of a function / and its deriv- 
atives (i — 0, 1, . . m, A* ^ ^ 0, 1, . . ., a, — 1; are 
given on the net A^j*. < . . . < ^ 

m 

the nodal points j:,, and, moreover, "t 1* 

We have to construct a polynomial whose values and 
derivatives up to the order — 1 at the nodes (i = 0, 
1, . . ., m) coincide with the values of / and its corre- 
sponding derivatives and to estimate the error. 

Interpolation of this kind is the interpolation in the sense 
of Hermite and the corresponding polynomial //„ is the 
Hermite polynomial. The numbers a, are the multiplicities 
of the nodes Xi. We can prove that the Hermite polynomial 
exists and is unique. 
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The remainder of the interpolation formula / (j:) ^ 
{x) can be represented as 

m 

l^{a,b). "" ( 1 ) 

Assume now for definiteness that 

xeia.fc]. (2) 

Usin^ this restriction and formula (1), we get the eslirnate 
of the error for a fixed point x: 

m 

\x-x,ri. (3) 

i=0 

It is now easy to construct an estimate, uniform througli- 
out the interval [a, 6], for the fixed net Ajn- Indeed, 

A, - max \R„{x)\^ max | Q„ (x) \ , (4) 

[a. b] b] 

where 

m 

Q„(x)- II {x-xip. (5) 

i=0 

Example. Construct the llermite interpolating polynomial for 
the function / = 1 — cos (nx/2) using the nodes = — 1 , 
xi = 0, X 2 ~ i with multiplicities = 1, — 2 and ag -- 1 

respectively. Get a uniform estimate of the error on the inter- 
val [— 1, ij. 

A We calculate the values of the function and of its derivative 
at the given nodes: / {xq) — f (xg) = 1, / (xi) = /' (xj) = 0. Then 
we construct the Hermite polynomial with due account of the 
multiplicities of the nodes: 




-1)(^ + 1) 

— 1 


Note that instead of a third-degree polynomial we have got a second- 
degree polynomial. This is a consequence of the symmetry of the 
initial data (but not of the function /). 

Let us now find the estimate of the error. Using formula (4) and 
bearing in mind that = (ji/2)^ for the function being consid- 
ered, we get 

^ \ / 4! ,j 

It is easy to show that max | x + l)x2 (a: — 1) | = 0.25. 

[- 1 . 1 ] 

Therefore the final result is < 0.065. A 
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7.16. Mathematical Apparatus of Trigonometric 
Interpolation 

III the sections that follow we consider the problem of 
approximating functions by means of a trigonometric 
polynomial. This means that we take a linear combina- 
tion of the trigonometric functions sin nx and cos nx as an 
approximating function. 

To give a formal substantiation of the choice of trigo- 
nometric functions as approximating functions, we need 
some knowledge from the course of analysis concerning 
the Fourier series. Below we give some data on the Fourier 
series omitting the proofs of the statements. 

Sequences. Series. Consider a function / (a.). We take the set of 
natural numbers as the domain of definition of this function, i.c. the 
argument x assumes the values 1, 2, . . ., n. A function of this 
kind is called a sequence. 

A sequence is written in the form 

• •! ^71* • • •» or 

Here is the general term of the sequence, is a term preceding 

and is a term that succeeds a^. 

Here are some examples of sequences. 

(1) The sequence 1, 2, 3, . . ., n, . . . whose general term = 
M, is known as a natural scale, 

(2) The sequence a^, ag, ...» • • •» ^or which — 

^n~i d, where d is a constant quantity, is an arithmetic progres- 
sion. To define an arithmetic progression, it is sufficient to know 
its first term and the common difference d. Indeed, the general 
term is expressed by the formula 

fln = + d (fl — 1). 

Since this formula can be used to find any terra of the sequeiuje by 
substituting the values n = 1, 2, 3, . . ., the sequence is consid- 
ered to be specified. 

(3) The sequence 63, . . ., ...» for which 6^ = 

bn-iQi where q is a constant quantity» is a geometric progression. 
To define a geometric progression, it is sufficient to know its first 
terra bi and the common ratio q. The general term is expressed by. 
the formula 

bn==b,q^-^. 

(4) The sequence Cj, Cj, . . .» c^» . . ., for which = c, where c 
is a constant quantity, is a constant sequence. 

(5) Here is another example of a sequence. Wo shall calculate 
the number e in succession with one, two, three etc. digits. We can 
represent the results of the calculation as 

2, 2.7, 2.71, 2.718, . . ., 

(1), (2), (3), (4) 
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Labelling the values obtained by natural numbers, as it is shown 
in brackets, we get a sequence. 

In addition to number scries, we shall consider functional 
sequences. 

Here are some examples of functional sequences: 

. (1) flo, 

(2) sin X, sin 2x, sin 3:c, . . ., sin nx^ . . . 

Hecall the detinition of the limit of a number sequence. The 
number A is the limit of the sequence {a^^) if for any e > 0 there is 
a number N such that the inequality ) — i4 | < e is satisfied for 

all n'> N. Then we write lim ~ A. 

n->oo 

A sequence which has a limit is a convergent sequence^ otherwise 
it is a divergent sequence. 

Example 1. Show that the geometric progression bq, bq^, . . ., 
bq'**'-^, ... is a convergent sequence for | g | < 1 and a divergent 
sequence for | g | ^ 1 . 

A (1) Wo shall first consider the case when | ^ | < 1. We 
shall show that 

lim = 

n-*‘Oo 


i.c. proceeding from the given e > 0, we shall find N such that the 
inequality | bq^^-^ — 0 | < e is satisfied for n > N. To do this, 
we solve the inequality for n. We rewrite it in the lorm 

|6| or kr-i<e/|&|. 


We take logarithms of the last inequality: 

(n - 1) In I g |< In (e/ | b |). 
Dividing both its sides by the negative number In | q 

\a\q\ ' ln| 9 | • 


we get 


- 1 >- 


Evidently, it is sufficient to take 


where E (x) is the greatest integer not exceeding x, as N. 

(2) Let us now consider the case when g > 1, > 0. We shall 

show that the sequence is divergent. To do this, it is sufficient to 
show that for any arbitrarily largo M there is N such that the 
inequality > A/ is satisfied for all n > N. Solving this 

inequality for w, we get 

‘ In g 

We take 

as N. 
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Note that for 7 — 1 the stufuence is constant ami lim bq^-^ - h. 

Wo can show that in all other cases the sequence is diverj^ent. ^ 
Consider a sequence ^21 • • •» • • •• expression of the 

form 

00 

I a2 + • • • + ^n + • • • = 

n-^1 


is a serif's; here a,, is the wth term of the series. 

The Slim of the lirst /? terms is its nih partial sum: 

71 

7 --I 


The sum of a series is the limit of the sequence of ils partial sums: 
lim S ji ■ S , 

n~*oo 

If a series has a sum, it is convergent^ otherwise it is divergent. 
Here are some examples of convergent and divergent series. 
Example 2. We consider a series resulting from an arithmetic 
progression 'Hd „iite its nih partial sum 


2 ai + d(n — 1 ) d „ 

2 



n. 


Evidently, as n tends to infinity, its partial sum increases indefi- 
nitely in absolute value and, consequently, the series diverges. 

Example 3. We consider a series resulting from a geometric 
progression for | 7 | < 1 and find its sum. We use the formula f(jr 
the sum of n terms of the geometric progression: 


5n- 


1-7 


h 

i-q 


1-7 


Wi‘ have proved (see lilxample 1) that lim 7 ^^ 

n-*<x> 

sequent ly. 


S— lim Sn 

7l-*oo 


\-q • 


(l7l <1), 


>n- 


Serics whose terms are functions are functional senes. Here are 
examples of functional series: 

Ao-t • • •, 

IfQ x-\ b.^cofi23r -j- . . cos (a ~ .... 

The first of them is a power series and the second is a trigonometric 
series. 

Let us consider a functional series 

Ui (x) + U 2 (x) + ... + (x) + . . ., 
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where (x) are functions defined on the interval [a, ft). Let xq 6 
[ay 6], and then the series 

Ml (a:o) + Ma (j-o) + ... + (a:o) + . . . 

is a number series and may prove to bo convergent as well as di- 
vergent. 

The collection of all values of j; ^ [a, &], for which the corre- 
sponding number series converges, is the domain of convergence of 
the functional series. 

It is evident that 


S(x)-^ lira Sn (x)y 

n-*oo 


n 

where 5 „(j:) = 2 “i W depends on the choice of the variable 
i=l 

Xy i.e. the sum S (x) of the functional series is a function of the 
point X. 

Let {iS^ (x)} be a sequence of partial sums of a functional series 
defined on the same closed interval [a, b]. A functional series is 
uniformly convergent to the function 6’ (x)y defined on [a, 6], if any 
e > 0 can be associated with a number Ny independent of x 6 
[ay ft], such that the inequality | {x) — ^ (a;) | < e is satisfied 

for any n^ N. 

Consider an example which illustrates the difference between 
the concepts of convergence and uniform convergence of a series. 

oo 

Example 4. Eor the series 2 t where 

n— 1 

the partial sura is 


5ft (*)=2 

i=l 




1 


1 

(1 + ^r • 


We shall show that the series converges on the interval being con- 
sidered. 

Indeed, if a: 0, then SJ^ (0) = S (0) = 0. Assume now that 
ar > 0. We shall prove that in this case (a:) = 1, i.e. using the 
given e > 0, we shall find N such that the inequality 


1 = 1 

(1+^r 


< e 


is satisfied for n^ N. Solving this inequality, we get 

We can See from the last relation that in general N depends 
not only on e but also on x and increases indefinitely for one and the 
same e for x tending to zero. This means that proceeding from the 
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given e, we canmU cho(»se a unique N for alia: ^ [0, 1), in other 
words, the series is not uni/ormly convergent on the indicated interval. 

This example shows that a sequence of partial sums continuous 
on a closed interval may converge to a function discontinuous on 
that interval. One of the reasons for the introduction of the concept 
of a uniform convergence of a series is that a uniformly convergent 
series of continuous functions has a continuous function as its sum. 

Expansion of functions in Fourier series. Many problems in 
science and engineering are connected with periodic functions which 
reflect cyclic jirocosses. 

The function / (a:) is periodic with period 7 > 0 if it satisfies 
the equality 

j(x)--=i(x+ T). (1) 

For practical purposes it is convenient to represent functions of 
this kind as trigonometric series or th(‘ir partial sums with suffici- 
ent accuracy. 

A functional series of the form 
00 

+ 2 («n COS nx sin nx) (2) 

n—\ 

is trigonometric, where and 6^ are real numbers independent of x. 

Assume tliat this scries converges for any x from the interval 
(—jt, Ji], and then it defines a periodic function / (x) with period 
T - 2n. 

A series of form (^2) is known as a Fourier series for the function 
/ {x) integrablo on the interval [~ jx, ji] if its coefficients can be 
calculated from the following formulas: 


1 

JI 

JI 



/ W d®, 


( 3 ) 


- JI 



1 

JI 

JI 



\ / (x) cos nx dx 

{«= 1 , 2 , ...), 

( 4 ) 


-n 




JI 




^ / (x) sin nx dx 

(n = l, 2 , ...). 

( 5 ) 




We can formally consider the Fourier series for the function 
/ (x). However, the following questions arise: (1) whether the 
Fourier series converges for the function / (x), (2) if the series con- 
verges, then whether it has/ (ar) as its sum. Dirichlet’s theorem 
gives answers to these questions. Before formulating this theorem, 
we shall recall some concepts. 

The function / (x) is monotonic on an interval if for any Xi 
and xa, which belong to this interval and are such that Xj < x*, 
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only one of the inequalities / (j'jX / (^^ 2 ) is 

satisfied. 

The function / (x) is piecewise-mo notonic on an interval if the 
interval can be divided into a finite number of open intervals in 
each of which the function is monotonic. 

The function / (j;) is piecewise-continuous on an interval if it has 
a finite number of points of discontinuity on that interval. 

We designate the limit of the function / (j?) when x tends to a 
from the right (right-hand limit) as / (a -f- 0) and, respectively, the 
left-hand limit as / (a — 0). 

Dirichlet’s theorem. If the function f (.r) given on the interval 
1 — Ji, Ji] is piecewise-mo notonic and piecewise-continuous^ then the 
Fourie, series of this function converges throughout the interval 
[ — Ji, Jij and its sum is equal to 

(1) / (a:) at all points of continuity belonging to ( — Ji, Ji), 

1 

(2) If (x — 0) f {x -|- 0)] at all points of discontinuity be- 
longing to ( — Jl, Jl), 

0) ■^ [/ ( — ^ + 0) + / (Jl — 0)1 at the endpoints of the interval, 

Cl 

i.e. at the points x — — Jl and x = JX. 

In what follows we shall write that 

00 

/ (^) = -^ + 2 (« 7 ? cos nx -|- sin nx) (0) 

n-- 1 

in the sense of Dirichlet’s theorem. 

Dirichlet’s theorem does not assert the uniform convergence of 
the Fourier series .to the function / (x). However, if we strengthen 
the properties which the function must satisfy, i.e. require that it 
should be continuous throughout the interval [— ji, ji], piecewise- 
monotoFiic on it and that the equality / (— Ji) = / (Ji) should be 
satisfied, then the Fourier series for such a function will converge 
uniformly to the function / (x) throughout the interval [— Jt, Ji|. 

We can show that for an even function all the coefficients are 
zero and the corresponding Fourier series does not include sines: 

00 

/ C^) -^+ 2 (hi cos nx, (7) 

Tl=l 

where 

Jl 

l{x)coanxdx (n^i), 1, 2, . . .). (H) 

0 

Similarly, for an odd function all the coefficients a,^ are zero and 
the corresponding Fourier series does not include cosines’ 

00 

f(x)^ S 

n=l 


( 9 ) 
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Jl 

. 2 (* 

^71 = "^ \ f{x)smnxdT 2, ...)• 


Example 1. Represent the function 


/(*)={ 


— X for — 

2x for 0 c .r ^ ji 


as a Fourier series. 

A We find the Fourier coefficients ot tluj function / (,/ 
formulas (3) and (4) we find the coefficients Uq and a^\ 

flo™— — i* ( — a:)d.2:4--^ i* 2j:dr — I — 

Jt J ' Jt ,1 K 2 ' TL 

-n 0 

0 zi 

If 1 i‘ 

— \ ( -- t’OS nx dx -|- — \ 2jr cos nx d r. 

Ji J Jt J 

0 

Inlej^rating hy parts, wo obtain 

0 0 

1/1.1 If. 


1 /J^ 
n \ n 


^ sin^.rd.r 


-jt ~ji 

71 


-^.rsilKir siiwrcdt) 


0 0 
n 


1 

/ ^ 

1 - ■ priQ fi 7* 

2 

i- ^ 

3xn 

1 ttJu 

\ n 

n , 

1 jin- 


■( i)"l, 




-ii(2int)^ (^-1.2,3,...). 


Tlio coefficients can be found from formula (5): 

0 jx 

If * 1 i* 

\ ( — J:)sin nxdj: [ \ 2c sin /?. j; dj' 

31 J Jt 

-Jl 0 

0 JI 

^ ^coanx I +-^ J cosnxdx 


:3-0104 
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Jt 7t 

, lx 2 \ 

+ cos nx — ^ \ cos nx Ax I 

0 

— (-i)”+2 — (-1)"] 

i.e. 

*2ft= ^2h-l= 2fc — 1 (*^1.2,3,...). 

Thus the Fourier scries of this function has the form 

oo 

= F 2 -(2FIl)rCOS(2/c-l)a: 

;t=i ^ 

oo oo 

2/c— 1 ^'"(2fc-'>) ^"4~ ^ \am2kx. 

In the interval (--Ji, n) the series converges to the function / (x) 
and at the points x = ±n: to the number 

-i-.l/(-n + 0) + /(n-0)]=-|-jt. 4 

Example 2. Represent the function 
. r— sinx for — 

/W — I sinx for 0<a:^ji 

as a Fourier series. 

A This function is even and, consequently, all the coefficients 
= 0 and can be found from formula (8): 

n 

2 (* 

= ^ sin a; cos nx da: (n = 0, 1, 2, . . .). 


From this we have 


Furthermore, 


ao = — \ sinxdx — — , 
“ Jt d JX 


Jt JI 

= ^ sin X cos nx dx = -^ [sin (n + l) ^ — sin (n — 1) x] dx 

b b 

( 0 for n = 2/c— 1, 

^l~ « = 2fc (fc=l, 2, 3, ...). 


for n = 2k—i, 

for n = 2k (fc=l, 2, 3, ...)• 
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Coiise([Uciitly, 

oo 

/(a:)== |sina:| ^2 4 fe 2 ^_i COs2fa. 

fe=l 

Note that the series obtained converges to the function | sin a: | 
throughout the interval [ — Jt, Ji]. 

Example 3. Repn'sent the function 

f — 1 for — jt <; x < 0, 

/ (•'*^) “ S lor 

t 1 for 0 <: a: < JI 

as a Fourier series. 

A This function is odd and, consequently, all the coefficients 
— 0 and b,^ can be found from formula (10): 

n ji 

Z C 2 I 2 

6r, — \ 1 -sin MX da:— cos nx — — M — ( — D’^l. 

JI ,1 nn I 3XK ^ ^ ^ 

0 0 

Thus all the even coefficients are zero and the odd ones have 

4 

the form /or — rr * ^Consequently, 

3X \ZfC ~ ~ x) 
oo 

sin (2Ar — 1) X. 

Evidently, at the points x — 0 and x — ± Jt the sum of the series 
is equal to Z(*ro. 

Example -1. Represent the fund ion 

( ./ for 0 < x < 1, 

' 1 1 for 1 < X < 2 

as a Fourier series. 

A Since the function is defined in an interval different from 
( Jt, 3x), we make a change of the independent variable using the 
formula x (x' | 3x)/jx, orx' ^ ji (x — 1). Thus we get a function 


i 1 for 0 < x' < 7f, 

Since this function is defined in the interval (— jx, ji), we can write 
a Fourier series for it. Wo calculate the coefficients of this series: 

JX ,1 JI JX .1 Z 

-n 0 

0 3t 

cosnx' dx' I C i*cosnx'dx' 

JI ,1 JX JX ,1 


1 i* x' -t 


28 * 
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u 

= — ^ C sin nx' dx' = — ^^[1— 

nn^ J ^ ^ ” 

-jr 

0 n 

hn = — \ --- sin nx* dx' I -— \ l*siny 7 x'dx' 

n ,j JT. ji ,) 


-ji 

0 


=1^5*- 


sin «x' dx' — ■ 


0 

(-ir 

nn 


Consequently, 

oo 

3 2 1 

Ii^) = -^+^Zi ' ( Y fe- ip co 3[(2A:-1) Jt(.t— 1)1 


fc=l 


1 ( — 1 )" 

^ Zi — - — siu[«n(i — 1)1. 


n=l 


We calculate the values of the sum of the scries at the endpoints of 
the interval: ' 


1 0 - 1-1 1 
-|- [/ OH - 0) + / (2 ~ 0)1 = — tL i . 


Tlje result obtained makes it possible to find the sum of the num- 
ber series 

oo 

5= 2 (2k^iy‘ + ••• + (2fc-l)'^ ■ 

ft=l 

Indeed, on the basis of Dirichlet’s theorem, for x — 0 or x — 2, 
we have 

13 2 ^ 1 

2 ' ' 4 3x2 Zj (2/c — 1)2 » 

/i=l 

whence it follows that 

^ (2fc— l)a “ 8 • ^ 
ft=l 

It should bo pointed out in conclusion that the integral of the 
function / L^) results from a term-by-term integration of the corre- 
sponding Fuurier series and the derivative/' (x) can be obtained by 
means of a term-by-term differentiation. The condition / (— 3x) = 
/ (ji) is obligatory in differentiation. 
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7.17. Trigonometric Interpolation 

The operation of representing the function / (x) as 
a Fourier series is known as a harmonic, or Fourier, analy- 
sis, In practice, we have to restrict our computations to 
the first few terms of a Fourier series. As a result we get 
only ail approximate analytic expression for the function 
/ {x) ill the form of a trigonometric polynomial of or- 
der N: 

N 

(J^ (a;) _ I - 2 cos fix + sin nx) 

n=i 

{ — n^x^n), ( 1 ) 

Meside this, formulas (3)-(5) from 7.l() are suilahle for 
calcailation of Fourier coefficients only in the case of an 
analytic representation of the function, tn practice, as 
a rule, the function / (x) is given in tabular form or as 
a graph. Tl,( ^ problem arises of an approximation 
of the Fourier coefficients with the use of a linite num- 
ber of the available values of the function. 

Generalizing all we have said above, we shall formulate 
a problem of the numerical, or, as it is also called, har- 
monic analysis: we have to approximate, in the interval 
(0, T) by the trigonomclric polynomial of order N, the 
function y ~ f {x), for which we know ni of its values 
Uh = / (^/i) = hTini {k 0, 1, 2, . . ., ni — 1). 

A trigonometric polynomial for the function defined on 
the interval (0, T) has the form 

N 

Qn -y- I S («n sin n x) . (2) 

n=l 


The coeflicients a^ and are ihdjned by the following 
relations: 
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Employing, in (3) and (4), the rectangular formula for 
calculating the integrals from the values of the integrands 
at the points Xh ~ kT/m (A = 0, 1,2, . . ., m — - 1), we 
have 

m- 1 

2 ' "v ^ 2 jcA^ /c\ 

2s yh cos n — , (5) 

1 , 2 , 

m- 1 

S (6) 

Thus the trigonometric polynomial (2) whoso coefllcients 
a, I and bj^ can be found from formulas (3) and (h), serves 
as a solution of the problem posed. 

We can show that for m > 2N polynomial (2) is the 
best approximation of the function / (a) in the sense of the 
method of the least squares if its coeflicieiits arc calculat- 
ed from formulas (5) and ((5). To put it otherwise, coeflici- 
enls (5) and (6) minimize the sum of the squares of the 
deviations 

m - 1 

S (7) 

ft =0 

In a special case, when m == 2W, the coefficients (la and 
bn (/i — 0, 1, 2, . . — 1) are delined by relations (3) 

and (b) and tlie coeflicient is 

m- 1 

2 (— ( 8 ) 

The polynomial Q ^ (a) itself becomes an interpolating 
polynomial since in this case, for any there hold rela- 
tions Qj^ (xu) = i/u for all Xf^ = kT/ni (A: = 0, 1, 2, . . 
m - 1). 

■ Example. We investigate the dynamics of the production of 
sugar from sugar-heet. This production is of a periodic nature which 
is due to the periodicity of growth and the conditions of preservation 
of raw material. Therefore, we can take the trigonometric polyno- 
mial (2) for fn = 12 as a function approximating the dynamics of 
sugar production. (This corresponds to the number of months in an 
annual cycle and makes it possible to roveal the peculiarity of the 
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production, its seasonal nature.) Consequently, 

N 

<?wW = -^+2 (anCoaft-|-a:-l-6nsinn-^ (0<z<11). 
n=l 


In economic investigations, not more than four harmonics are 
usually chosen for a good approximation of a dynamic periodic 
series. 

The expressions for the coeffficients and bj^ have the form 


11 


yii cos n-j^Xh 


11 


0 /j [//i Sin 71 Xfi, 


h=0 


k=^0 


Wo calculate! these coeflicients for the first four harmonics of the 
polynomial (x) and tabulate the necessary computations (see 
Table 7.13). 

From this table we find that Uq — 108, aj -= 34.99, a.^ '-= 7.75, 
— — 3, <74 == - 1.25, bi = — 0.11, 6.2 — --11.98, — — 4, 

1)^1 -1.59. Thus we have the following four mathematical models 
of the seatviiax uHiure of sugar production: 

Qi (x) --- 54 + 34.99 cos x -- 0.1 1 sin x, 


O., (x) — 54 1-34.99 cos x - 0.1 1 sin x + 7.75 cos x 
^ ‘ 6 0 3 


— 11,98 sin X, 


(x) 54 + 34.99 cos x — 0.11 sin ■^"^ + 7.75 cos .r 

— 11.98 sin X ---3 cos x — 4 sin x, 

(.r) -- 54 I 34,99 cos x — O.ll sin x-|-7.75 cos x 


- 11.98sin -g- X — 3cos — X — 4sin -; 5 -x 

. nr- I jI CZr\ • 

— 1.25 cos -g- X 1-1.59 sin x. 

When wo compare Qi (x^) with the respective values of we 
see that already the first harmonic yields, in general, a correct mod- 
el of the dynamics of sugar production, indicating its seasonal 
nature. 



Months I II III IV V VI VII VIII IX X XI XII 



COS 
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Let us calculate the mean quadratic 



lQi(xk)—ykV for all Qi{x). 


We find 


deviations 6^ = 
that = 37 . 80 , 


62 = 14 . 40 , 63 = 7.59,64 = 5 . 75 . As would be expected, the val- 
ues of 61 decrease monotonically with an increase in i, 64 differing 
but little from 63. In addition, the values of 63 and 64 themselves 
are small and therefore the polynomial ^3 (x) is already a close 
approximation of the series which characterizes the annual dyna- 
mics of sugar production. 


7.18. Numerical Methods of Determining the Fourier 
Coefficients 

Consider a Fourier series converging to the periodic 
funcLion / (.z): 

/(x)=--^ I ^ (u,a cos sin f/ix), (1) 

»i=i 

where 


j f(x)cosmxtU' 

-Jl 

(m-O, 1,2, . . .), 

(2) 

Jl 

j / (z) sin mx dz 

tJI 

(m- 1,2,3, ...). 

(3) 


In the preceding section we formulaled a problem of 
approximation of the function / (.z) by the trigonometric 
polynomial (z). We used there the rectangular formu- 
la to calculate the coefficienls and ^vith the aid of 
integrals. 

fn the general case, the approximation of the coefficients 
am and is based on the replacement of the integrals in 
formulas (3) and (4) from 7.17 by their values obtained 
from one of the formulas of approximate integration. In 
this section we shall use the trapezoid rule. 

We assume that the function / (.z) is periodic with peri- 
od 2ji. Note that when determining the coefficients and 
bm^ we can consider any integration interval 2ji long 
rather than the ordinary integration limits from — n 
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to Jt. To make the calculations more convenient, we take 
an interval from 0 to 2 jx so that 

2n 

^ J f (x) cos mx dx (w — 0, 1 , 2, . . . ), (4) 

0 

2n 

^ f (x) sin mx dx (w— 1,2, 3, ...). (5) 

0 

Dividing the interval [0, 2n] into N equal parts, we 

gol division points 0, 1--^, 2.-^, . . . , (AT— 1) , 

2n. We designate the Corresponding values of the function 
/ (./:) at the division points as //,, /y^, . . /y^v-i^ Un = 

//(). Applying the trapezoid rule, we got the following 
approximate formulas for the calculation of the coeflici- 
ents (ini and / 

N- 1 

- 2 -«o - S Uh- J/o l-Z/i-H... I-Un-i, 

h--^0 

N-[ 

N ^ , 2mn . 

-j- Zj Uh Uo I ■ //i -pT 

h -0 

I / AT A \ 2fHTL 

••• +'/w-iC«s(iV— 1)-^ , 

N-[ 

IV j "sn . , 2wji . 2niji , 

- 2j yh k—^ - IJ^ Sin -I- 

/i-l 

Assume that N — 12, i.e. tJie inti*rval 10, 2 ji 1 is divid- 
ed into 12 equal parts so that we use the values of the 
argument 0, ji/fi, jr/3, . . ., lljt/O, associated with the 
values of Ihe function //„, //i, //o, . . ., //n, and tln^ values 
l)y which these' values are multiplied are it 1 , 
4: sin(n;/G) — 4; 0.3, ± sin (ji/3) — ± vt.SGG, From this, 
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omitting cumbersome comput«^tioiis, we obtain 

J/o + !/l +^3 1' ^4 + ^5 + y6 + y7 + ^/8 + l/o + //lO //ll» 

6ai -- {y-i. + Vio — Vi —ys) sin 

+ (i/i + y 11 — i/s — yi) sin - J + (yo — ye) . 

^“2 ^ (tfi H- ys - 1 - yj -I- yu—y-i — yi—ys— yw) sin -|- 

-! (!/o +ye—y3—y»), 

- "o +yi+ys—y 2 —y 6 — Vm 

ii^i -=■ (.Vi -h yj - ^7 — !/n) sin 

+ (.^2 + ^4 — y s — y lo) sill Y -I - (^3 — yo) . 

6^2 (yi -1' y-i 4 y? 4- y^—Vk— .vs — yio— yn) si“ y ’ 

6^3 = yi 4- ys 4- y9 — ys— y?— yii. 

and so on. 

I'o mijiiinize the number of arithmetic operations neces- 
sary to obtain the values of cim we use a special 

computing scheme known as Uuiige’s scheme. 

\st step. We WTite the values of the function / (.c) in the 
following order: 

Uo Vi Ui y-3 Ua yh ye 
yn yio y^ ys yi 

2nd step, W-e calculate the sums and the differences of 
each pair of values whicli are under eacli other and write 
the resulting sums and differences as follows: 

yo yi y^ vz y^ ys ye 
yii yto yd ys yi 

sums Uq U 2 Uf^ U5 Uq ^ 

differeiicos Vi 

3rd step. We perform similar operations with the sums 
and differences (0): 

Uq U 2 U 3 V 2 Vs 

sums Cq Cg r., gj ^ ' 

differences d^ d^ dg 
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Aih step. We calculate the values ol* and bm using the 
approximate formulas 


Oflo — ^0 + ^1 'h ^2 + 

{\ai == rff, O.HGlirfj |- O.M.,, 

<'«2 = (co — C3) 1 - 0.r)(r, - ^2), 

bfitg = ^2* 

6/>i = 0.5^, -1 ().8()f5/72 1 A'.i' 

0;^2 = 0.8()()(/ i , — * 2 ), 

•'/>;) = Si — S3, 


( 8 ) 


and so on. 

To compare the coefficients a,^ and bjn obtained from 
approximate formulas with their exact values, we give an 
example in which the function is represented analytically. 

Example. Consider a periodic function with period 2n: 

f x/n for 0 ^ .T ^ jT, 

// / (.t) < 1 for ji < .T < 2^, 

I i) for X — 2ji. 


Wo compile a table 



0 

Jt 

71 

Jt 

2ji 

5jx 


7jt 

4jt 

3jt 


tIjT. 

2jt 


G 

3 

2 

3 

G 

Jt 

6 

3 

2 

3 

G 

Vh 

0 

1 

1 

1 

2 

5 

1 

1 

1 

1 

1 


' 0 


6 

3 

2 

3 

6 





1 

1 


In accordance with Rungo’s scheme we write the values of and 
carry out the additions and subtractions indicated in it [see for- 
mula (())|: 


sums 


(I 


0 


0 

1 

7 

6 

6 


3 

1 


4 


3 

2 

3 


2 


1 

7 

2 

2 




1 



diffL'iences 


6 
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Next we perform subtractions and additions with respect to the 
sums and differences obtained [see formula (7)]: 

sums difforences 


0 

1 


_7 

6 

li 

6 



6 3 

i 

() 3 


1 


3 

^ 2 


— 1 —1 — ^ 


differenced — 1 ^ 

o o 


2 1 

differences — — 

o o 


Then wo wrile the expressions for and bm- 


Oa,- 1 + 3 + 3 + ^ , 


66i --= '■'•5 ( - 1) -|-l>.86(i ( -- 1) - — , 

Gb 2 = ().866 (— , 

3 


Gfl] = — 1 — 
Coj 
6a, 

Hence 


= (l— 


66 , 


-‘-(-i)- 


flo = 1.417, di = - 0.291, fla ^ - 0.083, - - - 0.111, 

= — 0.311, 6a = — 0.144, 63 = ~ 0.083. 

To make the comparison, we give the exact values of the coef- 
ficients: 

flo = 1.500, ai = — 0.203, = 0.000, = — 0.022, 

bi = — 0.318, 62 = — 0.159, 63 = — 0.106. 


To obte^in moro accurate values of the coeflicients from 
approximate formulas, we can use schemes with a larger 
number of ordinates. 

Note that the practical harmonic analysis makes it possi- 
ble to obtain analytic expressions whicli would approxi- 
mate the given functions with the least mean square error. 


7.19. Backward Interpolation 

Interpolation of functions proves to be a useful appa- 
ratus in problem solving. The problem of determining 
a root of an equation or a root of a function is a typical 
example of the use of an interpolating polynomial. 
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Consider the following problem of backward interpola- 
tion. A function / (a:) continuous on the interval [a, b] is 
specified on the net ^ < • • . < a;o < 

. . . < < . . .^ 6 by its values (i = 0, ± 1, . . 

± k). We have to find the value of the argument 
^i) corresponding to the specified value of the 
function /* = /^ + 0 (/^ — /^j), 0 g (0, 1). The interval 
(:ro, is assumed to be so small that x^' is unique. 

In essence, wc have to find here the root of the equation 

/(x) =/*. (1) 

One of the possible ways of solving this problem is the 
following. We approximate the function / (a:) by its inter- 
polating polynomial (/, x) and replace equation (1) by 
the equation 

l\ {/, X) = J*. (2) 

We find the ▼'onl root x* of equation (2) belonging to the 

interval {xq, oji). For all practical purposes we get only 

an approximate solution of equation (2), i.e. the value x*. 

Now we assume that a;* = x*, 

Ijot us estimate the error of this solution. Assume that 
the total error of interpolation is A, i.o. 

1^. (A ^) -/{^) l< A (3) 

and the error of the solution of equation (2) is r, i.e. 

I a;* — X* 1^ B. (4) 

Then the increment of the function / at the point .t* can 
be represented as 

/* — — g3.-.r* + 0 (.r*-x*),0g(O, 1). 

From this, with due account of the fact that /* = 
Pn (/» we have 

Pnif. X*)^f(x^) 

We assume now that min | /' (.r) j ~ mj > 0, 

IXof Xi] 

and, using estimate (3), we obtain 

I a:* — X* 1^ A//??!. 


( 5 ) 
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Furthermore, 

I X* — X* I = I x* — x* + x*—x* 1^ I .X* — I* I + 1^* — J*| 
and, by virtue of inequalities (4) and (f)), we finally get 

Thus, both the solution of the problem posed and error 
(()) are defined by two processes, the conslrnction of an 
interpolating polynomial and the solution of equa- 
tion (2), i.e. the search for the roots of the ifiterpolaling 
polynomial. 

These two moments may seem to be unrelated. This 
is not so, however. 

It should be borne in mind that a rise in the degree of 
the polynomial decreases the error A on the oue hand and 
increases the labour needed to solve equation (2) on the 
other. 

Therefore, the degree of the interpolating polynomial 
must be the lowest in order to achieve tlie required accu- 
racy. 

In the practical solution of a problem of backward in- 
terpolation on a uniform net, Stirling’s and Bessel’s po- 
lynomials are usually taken as interpolating polynomials. 
In that case, equation (2), written with respect to the 
variable t = (x — XQ)/h^ is reduced to the form t = 
fp (t) and is* solved with the use of an iterative 
method. 

When using Stirling’s polynomial, we have 

' (/•-/. ■ • ■ ) • (7) 

The use of Bessel’s polynomial gives 


fit 2 


/1/2 


3! 




(8) 


As the initial approximation we take -77r(/*“/o) 

“70 


1 1 

in the first case and 0.5 or — (/* — fi/i/a) in 

^ /i/a 


llio 
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second case. When i*, which is the solution of equa- 
tioji (7) or (8), is obtained, x* can be found from the for- 
mula = Xq 

Similarly, if a necessity arises, we can get a solution 
of the set problem by means of Newton’s first or second 
interpolating polynomial. 

Let us consider the second method of solving a problem 
of backward interpolation based on the existence of a 
function g (y) which is the inverse of / ( 2 :). 

Assume that tlie function g (y) is continuous with a suf- 
iicient number of its derivatives on a minimum interval 
containing the values iji = /i (i = 0, ±1, • • •) and 
//* = /*. In this case the search for x^ is equivalent to 
tlie searcli for tlie inverse function g (y) defined by its 
values Xi at the nodes yi, at the point y = /*, since 

We have thus reduced the given problem to the proh- 
lern of interpolating the inverse function g (//) and 
calculating g \j 

This method of solving a problem of backward interpo- 
lation is more efficient than the method which includes 
a solution of an equation as one of its stages. It is espe- 
cially convenient when we have to lind a solution of a prob- 
lem for a large' number of values /* or to obtain ari 
(‘xplicit expression for the root of equation (1). The 
drawback of tlie second method is the requirement that 
a smooth inverse function should exist, a condition 
which cannot always h(‘ fulfilled (for instance this require- 
ment cannot ho satisfied for nonmonotonic function^). 

It should he pointed out in conclusion that to calcu' de 
.r* by means of an inver^se function, Ail ken’s iterative in- 
terpolation presented in 7.13 is mosl convenient. 


Example 1. Using the table of values of the function / = 3^' giv- 
en in the example in 7.9, find out the value of the argument x* to 
which the value of the function /* = 5 corresponds. Estimate the 
error. 

A In the example in 7.9 the order of correctness of the table 
is 3. Since this value of /* is at the end of the table, it follows that 
to calculate x*, w'e must use Newton’s second interp«)lating polyno- 
mial of the third degree. Setting j-q = l.oO and t = (x — XQ)/h and 
using formula (10) from 7.9, we get an equation for determining t*: 


5 = r> . 196-1- t - 1 - t{t + i) 


1 ! 


11 .072 
3! ' 


(M-l)(l-! 2). 


2 /. -01H4 



3/6 
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Taking into account the results of the example from 7.9, wc 
calculate the error of the value of x* from formula (5). Since A - 
Ai + Ao = 0.004 and mt = min | 3* In 3 | 2.5, the 

[ 0 . 75 , 1 . 5 ] 

required error constitutes \ x* — x* | ^ A/m^ — 0.0016. 

We reduce the equation for to a form convenient for the use 
of an iterative method: 


5 — 5.196 1 

1.248 1.248 


r0.3'H) 


^ + l)“F 


0.072 

3! 


(< + l)(t-h2)] 


and solve it taking = (5 — 5.196) 4- 1.248 ^ — 0.16 as the 
initial approximation. Then 


(-O.d(i) (0.84) (1 . 84) J- -0.141, 
_0.16-j^ pl^(_0.l41) (0.859) 

+ ^^^(-<'.141) (0.859) (1.859)1-= -- 0.14,3. 


We can thus take the value t* ~ — 0.14 ± 0.003 as the approx- 
imation of the solution of the equation. Hence 


X* — j-Q + t*h = 1.465 
and the error of the solution of the equation 


• I a;* — O'* 1 ~ a <C 0.0008. 

Thus the final solution is x* ~ 1.465 ± 0.003. 

Example 2. Using the table of values of the function / ^ In x 
given in Example 1 in 7.13 (see p. 340), calculate e^ with an accura- 
cy of 0.01. 

A The function / has an inverse g (y) — which is continuous 
together with its derivatives on the interval (— oo, oo). We can 
therefore reduce the calculation of eV to the calculation, at the point 
y = y* = 2, oi the function av given as a table 


y 

0.00 

0.69 

1.39 

1.61 

2.08 

2.30 

g 

1 

2 

4 

5 

8 

10 


We use Aitken’s method to solve this interpolation problem. 
We enumerate the nodes yi as follows: yg 2.08, y^ — 2.30, yg “ 
1.61, ^3 = 1.39, ^4 — 0.69, ^5 = 0.00. Using now formula (1) 
from 7.13 and replacing xhy y and Xy^ by we calculate the val- 
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ues of the interpolating polynomials (y*): 




Pf (2) . 


1 

^).22' 


8 

10 

5 

8 


7.40 

7.27 


— 0.08 
— 0.30 
0.39 
— 0.08 
0..39 
— 0.30 
O.Gl 4 
0.39 5 
0.61 6.77 
0.08 7.49 
0.61 7.41 

— 0.30 7.37 


==7.27, 


7.40, 


7.37, 


= 6.77, 

= 7.41, 

I 

= 7.38. 


Since | (2) — P?*^ (2) | = 0.01 and the required accuracy 

is attained, we terminate the calculations and set e^ = 7.38 ± 
0.01, A 
Exercises 

1. The function y ~ f (x) is given as a table 


X 

1.522 

1 1.523 

1.524 

y 

2L477 

2‘L9'^6 

21.354 


Find its value at the point x — 1.5228 using Newton’s first 
interpolation formula. 

2. The function y f (j*) is given as a table 

I 1,529 I 1.53 ^ I 1.531 
1/ I 23.911 I 24.498 j 25.115 

Find its value at the point x -- 1.5303 using Newton’s &« cond 
interpolation formula. 

3. Construct Lagrange’s interpolating polynomial for the func- 
tion given as a table 


X 

-2 

-1 

2 

1 ^ 

y 

-12 

1 

00 

3 

5 


4. Construct Lagrange’s interpolating polynomial for the func- 
tion / (r) = e-^ if the points jtj, = 1, = 2, .r.^ — 3 are interpo- 

lation nodes. Estimate the error for x -= 1.5. 

5. Compile a table of finite differences for the function given 
as a table 


X 

1 

-1 

0 

1 

2 1 

3 

y 

10 

1 5 

1 

-15 

-20 

- 100 












392 Computational Matheraatrcs 

6. Compile a table of divided differences for the function given 
as a table 

X I -3 I 1 I 0 I 2 I 3 

y . I -15 I -7 I 1 I 25 I 47 

7. For the fiiiiotion y — f (x) givoii as a table 

I 1 1.03 1 1.08 1 1.010 1 1.23 I 1.20 |1..33 | 1 .30 

y I 2.80107 I 2.94408 1 3.18993 1 3.42123 1 3.52542 | 3.78104 1 4.01485 

calculate the value at the point x = 1.21555 with an accuracy of 
10"® using Aitken’s method. 

8. Using Stirling’s formula, find the value of the function 
V ~ f (x) at the point x = 1.34627 if the function is given as a table 

a: I 1.335 | 1.340 1 1.345 | 1.350 | 1.355 | 1.360 

y I 4 . 10206 1 4.25562 1 4.35325 | 4 .45522 | 4 ..50184 | 4 .674.33 

9. For the function given as a table 

I '1.435 I 1.440 I 1.445 

y I 0.892687 1 0.893098 j 0.894700 

determine th(‘ value of the argument corresponding to the value 
of the function 0,. 89291 4. 

10. Use the method of backward inl(*rpolation to find, with an 

accuracy of 10“^, the root of the equation 1 x h 1 ~ ~ ^ which 

lies on the interval [0.7, 0.8]. 

11. Construct an interpolating polynomial for a function 
given as a table 


y I 384.6 I 507.9 ] 477.9 

12. Construct an interpolating polynomial for a function given 
as a table 


a: 1 I 2 I 3 

y I 349.1 I 416.9 | 430.6 

13. Calculate the value of the function / (x) at the point x - x^ 
using a requisite interpolating polynomial and employing four- 
digit tables of trigonometric functions with the stepsize of 1°. 
E.stimate the absolute error of the result in the following cases: 
(a) / (x) sin x^ x^ ~ 37.7°, (b) / (x) = cos x, Xi — 19°48', 
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(c) / (r) — sin .r, — 53°12', (d) / (a:) = cos x, Xi — 3fi°48', 

(o) / (x) = cos a:, xi 71^)', (f) / (x) - tan a:, xj = G7°48'. 

14. Sot uj) a tri^onomotric interpolating polynomial for the 
function y — f (x) defined in the interval (0, Ji) and given as a ta- 
ble of values of ijh / (xh): 


k 

0 

1 

2 

3 


(1 

Ji/4 

jt/2 

3;i/4 

yh 

1 

2 

2.4 

2.0 


15. Sot up a trigonometric polynomial of the order not lower 
than the second for the function y -- f (x) defined in the inUTval 
(0, 1) and given as a table for the values of -- / (xh). 


k 

0 

1 

2 

3 

"l 

5 


0 

1/C. 

1/3 

1/2 

2/3 

5/0 

Uh 

1 

0 

*) 

— O 

0 

2 



Chapter 8 

Numerical Differentiation 
and Integration 


8.1. Statement of a Problem and the Basic Formulas 
for Numerical Differentiation 

When solving practical problems, it is often necessary 
to obtain the values of the derivatives of various orders 
of the function / given as a table or as a complicated ana- 
lytic expression. In that case a direct use of the methods 
of differential calculus is either impossible or difficult. 
Then use is made of approximate methods of numerical 
differentiation. 

The simplest expressions for derivatives result from 
differentiation of interpolation formulas. 

Consider the following problem. The values // of the 
function /, continuously differentiable n \ m times, 
are defined on the net Xq d Xi <C . . . d b at 
the nodal points Xi, We have to find the derivative 
j{m) ^ 1 )] estimate the error. 

One of the possible methods of solving this problem is 
the following. Using the nodal points xi (/—(),!,. . ., n), 
we construct fdr the function / an interpolating polynomi- 
al with the remainder such that 

/ (X) = (X) + Rn (X). (1) 

We differentiate the right-hand and left-hand sides of 
relation (1) m times and set x = x*: 

/(^) (x*) - (x*) + RT (^*)- ( 2 ) 

For sufficiently smooth functions, i.e. for functions with 
bounded derivatives, sufficient number of nodes and suf- 
ficient accuracy of calculations, the quantity R\^^ (a;*) is 
small and^}/”^ (.r*) is a good approximation for 
and so we can set 

/(m, ^ pm) (^♦) 


( 3 ) 
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In practical computations, numerical differentiation 
proves to be very sensitive to errors in the initial data, 
to the discarding of terms of a series and other operations 
of this kind. In addition, the high accuracy of interpola- 
tion the [smallness of (j:)1, does not guarantee a high 
accuracy of the interpolation formula for the derivatives 
[the smallness of (j:)]. Therefore one must be care- 
ful in applying the methods of numerical differentiation, 
using it, as a rule, for small m. 

Bearing in mind all we have said and also the fact that 
the calculation of derivatives of higher orders can be 
reduced to a successive calculation of lower-order deriva- 
tives, we shall consider in more detail the technique of 
obtaining formulas for computing /' and f at the nodal 
points of a uniform net. To obtain derivatives at the 
nodal points, it is expedient to use Stirling’s interpolat- 
ing polynomial and its remainder [see formulas (5) and 
(()) in 7.^1 ^bus, differentiating Stirling’s polynomial 
and its remainder with respect to x and setting a:* - 

(t* - 0), we get the following expressions for the 
derivative: 

(5) 

Differentiating Stirling’s polynomial twice with re- 
spect to X and calculating the value of tl»e second deriva- 
tive at the point x* — .r„, we have 

( 0 ) 

f w - ('i - -r /:) ± ■ ->■ 

The derivative at the exact middle point between the 
nodes x* - x^ f y can be calculated with the use of 

Bessel’s polynomial. In this case the appropriate formulas 
for the derivative have the form 



(/c-l). 



± 


64 ') 


(/c-2). 


(S) 

( 9 ) 



376 


Computational Mathematics 


Of practical interest are the so-called formulas for one- 
sided differentiation which make it possible to calculate 
f (Xf^) using the nodal points = Xq + ih {i = 0, 1, . . 
k, ... or i = 0, — 1, . . ., —A, . . .). It is convenient 
to sot up these formulas with the use of Newton’s first 
ajid second interpolating polynomials. 

Differentiating Newton’s first polynomial with respect to 
X and calculating the value of the derivative at the point 
X — Xq (t — 0) for k = i and /c = 2, we get the formulas 

( 10 ) 

/' (x„) _ ± ( A/o-i- A2/„) ± ± (11) 

respectively. 

Similarly, differentiating Newton’s second polynomial 
for A; = — 1 and k — — 2 we obtain 

f'{x,) = ^Vfo±~M^h, (12) 

/'(.ro)=-i(v/o + | Wo) (13) 

respectively. 

8.2. Peculiarities of Numerical Differentiation 

Hero we give again all the second -order formulas ex- 
pressing fiiiitS differences appearing in them directly in 
terms of the values fi of the function. From relations (4), 


(6) and (8) from 8.1 we have 

'' w ” ± ^ (') 

Relations (11) and (13) from 8.1 yield, respoclively, 
formulas 

' ^ W 3/„ -h 4/, - /,) ± h-^ ; (4) 

' /'(®o)=--i(3/o-4/_,-F/_,)±-§^fe?. ;(5) 
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We can see from the formulas given above that the 
error of tlje metliod diminishes with a decrease in the 
stepsize of the net. However, if tlie values ji of the func- 
tion are given approximalcly, say, with tlie same ab- 
solute error e, then the total error of the formulas for 
numerical differentiation will include an additional 
term which is inversely proportional to {m is the order 
of the derivative). Therefore, it is reasonable to decrease 
h only to a certain limit. 

To illustrate the aforesaid, we shall consider the right- 
hand side of formula (3). Its total error constitutes 





26 


( 6 ) 


Equating A' {k) to zero, we get the point of extremum ot 
the function A {h)\ 

Since A" (//) >*0, it follows that hg is the point of 
minimum of A {k) and 

A (/*o) - = T Kt (8) 


This relation means, in particular, that we cannot guar- 
antee, for any h, that (he error of the result will be the 
quantity o 

Similarly, using formula (2) for the optimum slei)size, 
we get an expression 


- 2 y ^ 


s 2.6 


M4 V M.^ ’ 

and, ii.siiiff I'onmila.s (-1) and (5), wo gol an e.\j)ri‘.''.'«ion 


(5>) 


K - 




6 


( 10 ) 


Thus, when calculating derivatives, we must lirst' liml 
the optimum stepsize of the initial table of values 

Example 1. Calculate /' (1.0) and f (1-4) for the function / — 
In X given as a table 

.T I 1.2 I 1.3 j l.'i I 1.5 I 1.0 

/ I' <).182:3 I 0.2020 I '0.3304 J * 0.4054 i ' 0.47iHJ 
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which contains the values h with all valid values in the broad sense. 
Evaluate the error of the result. 

A To calculate the required derivatives, we apply formulas (5) 
and (2) respectively. Then, using relations ^10) and (9) and the 
initial data, we get the following values for tne optimum stepsize: 

/■ fi-lO”** 

^ 01 “ y ^ when calculating /' (1.6) 

^ f 48 . 10-4 

^ 02 = j/ — — ^^^22 when calculating /"(1.4). 

Since ihe tabular data do not allow us to choose U.22 as the step- 
size, we take the closest possible number, 0.2, as h^. Consequently, 

/'(1.6) = A (3.0.47.10— 4-iU"54 + ().3364) = ('.624, 


the total error not exceeding 


A = 


0.73 


• 0.12 


4 . 10-4 

0.1 


-^ 0 . 01 ) 7 , 


and 


(1.4)-- ^ (0.4700 - 2-0.3364 -f 0.1823) - - 0.512, 


the total error- not exceeding 

2.9 4-10-^ 


= 0 .(' 2 . 


Although the estimates of the error are as a rule, too high, still it 
shows that the operation of finding the second derivative is more 
reliable than that'of finding the first derivative. ^ 

In some practical cases we have to find the derivative 
being given ojily a table of values of the function. Then 
it is evidently impossible to evaluate the error. We cal- 
culate the approximate values of the derivatives directly 
from one of the formulas (4)-(13) from 8.1, disregarding 
the error. 


Example 2. Calculate /' (1.3), /" (1.4) for the function / (a:) 
given as a table 

j I 1.2 I 1.3 I 1.4 I 1.5 I 1.6 
y = f(x) I 0.18 I 0.26 I 0.34 0.41 | 0.47 


A From formulas (4) and (6) given in 8.1 we obtain, respec- 
tively, 

/'(1.3) = j^.-l(0.34 - 0.26 + 0.26 - 0.18) = 0.8. 


/''(1.4) = ^j(0.41-0, 34 -0.34 + 0.26):= -1, ^ 
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8.3. Statement of a Problem of Numerical Integration 

Assume that we have to calculate the integral 

h 

/ = j / (x) Ax. (1) 

a 

We know from analysis that for the function / continuous 
on the interval [a, 6] integral (1) exists and is equal to the 
difference of the values of the antiderivative F of the func- 
tion / at the points b and a: 

b 

I -^tXx)Ax^=F{b)-F{a). (2) 

a 

However, in the majority of practical problems it is 
impossible to express the antiderivative in terms of ele- 
mentary functions. In addition, the function / is often 
given as a table of its values for deiinite values of the 
argument. All this makes it necessary to use approximate 
methods of calculation of integral (1) which can be con- 
ventionally divided into analytical and numerical 
methods. The former consist, in essence, in the construc- 
tion of an antiderivative and further use of formula (2). 
As to the latter, they make it possible to find the nu- 
merical value of the integral from the known values of 
the integrand function (and sometimes of its derivatives) 
at given points known as nodes. In this chapter we con- 
sider only numerical methods of integrating a function. 
The process of numerical calculation of an integral is 
known as quadrature and the corresponding formulas as 
quadrature formulas. 

Depending on the method of detinition of an integrand 
function, we shall consider two distinct, in the sense of 
their realization, cases of numerical integration. 

Problem I. The values fi of a function / which belongs 
to a definite class F are given on the interval [a, b] at 
the nodes x,. We have to approximate integral (1) and es- 
timate the error of the value obtained. 

This is the usual statement of the problem of numerical 
integration when the integrand functio’; is given as a 
table, 
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Problem II. On the iiilcrval la, b] the function f '(x) 
is given in the form of an analytical expression. We 
liave to calculate integral (1) with a specified limiting 
error e. 

: One of. the possible methods of solving the problems 
stated is based on the use of various quadrainre formulas 
of the form 

n 

7 = J / (x) ax ^ (b — a) 2 A if (x,) = / „ (?,) 

a i=l 

with the known remainder [f] ^ J or its esti- 

mate. 

In the general case the nodes Xi and the weight factors 
(weights) A i are not known in advance aiu] must be found 
when each quadrature formula (3) is derived, on the basis 
of the requirements imposed on it. 

In essence, the problem of numerical integration is 
ectuivalcnt .to the estimation of the mean value of a 
function. Indeed, llie mean value of a function on the 
interval («, b] is determined as follows: 

b ‘ 

a 

jaud therefore 

b 

^ f{x)dx~-{b-a)7. 

a 

In its turn, tiie calculation of the mean value of a func- 
tion is a' 'statistical problem which includes the problems 
of successive sampling and planning an experiment. Since 
it is difficult to pose such a problem, we shall consider 
in this' chapter only classical methods of numerical in- 
tegration based on the preliminary delinition of the 
node.^ at which the information on the function being 
integraled must be given and of the infonnarion itself; 
We' pa^is now to the algorithms of the solution of the 

problems formulated above. » 

Algorithm pf solution of Problem I. . . j 
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1®. Wo choojso a dcrmile quaflralure formula (3) and 
calcuJato I If llio values h of tlio fuiicliou are approxi- 
mate, then we calculate, in fact, only the approximate 
value for the exact value 

2°. We assume approximately that I ^ ly^, 

3°. Usinff a dehnite expression for the remainder or 
ils estimate for the chosen quadrature formula, we cal- 
culate the error of the method: 

Ax = 1/ -In I - _ 

''i®. We calciilale the computin^r error 7^^: 

- I In -~In I 

usin<,^ the errors of the approximate values 

T)®. We lind the total ahsoliile mror of the a[)proximate 
value 7„. 

A - I / |< A, I A.,. 

()®. We ohiain the solution of (he problem in the form 

r -■ In ± A. 

1^)r sufliciently smooth functions, i.e. for functions 
with a limited variation of th(‘ derivatives, tlie error of 
the quadrature fornnilas (3), for sufliciently large n, is 
small as a rule. Therefore, if the initial values h and 
the calculations of /„ are sufficiently accurate, we can 
expect that Ij^ will be a close approximation of 7. These 
considerations serve as the basis for the following al- 
gorithm. 

Algorilinn of solulJoii of Problem II. 

1°. We represent e as the sum of three nonregative 
terms: 

e = El -{- + £.31 

where is the limiting error of the method, 83 is the lim- 
iting error of computation of 7^, is the limiting 
error of rounding off the result. 

2°. We clioose u in the quadrature formula such that 
tlie inequality 

A, I / — y„ I - I /?„ I ^ El 


is satisfied. 
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3°. We calculate h with an accuracy which would en- 
sure the validity of the inequality 

A2 “ l-^n ^ n I ^ 

when In is calculated from formula (3). To do this, it is 
evidently sufficient to calculate all /,• witli the absolute 

error ^ . 

( 6 - a) 2 Mil 

_ 

4° We round off the value of found in item 3"" (if 

63 0 ) with the limiting error 63 to the value 

5°. We obtain the solution of the problem in the form 

/ = /n ± e. 

As we have mentioned, the quadrature formulas used 
in the algorithms of the two problems are constructed 
on the basis of some criteria defining the position of the 
nodes and the values of the weight factors. Here are some 
of the criteria that may be used: representation of an 
integral as an integral sum, approximation of an inlc- 
grand function (say, by a polynomial) followed by the 
integration of the approximating function, the require- 
ment that formula (3) should be absolutely exact for 
a definite class of functions, and others. 

8.4. Basic Quadrature Formulas 

Rectangular formulas. As is known, by virtue of its 
construction the definite integral is the limit of integral 
sums 

h n 

\ / (a-) da: -- lim 2 ( 1 ) 

J inax/i.-*0 . , 

a * 1=^1 

each of which corresponds to a certain division 
a — Xq <C <1 ••• <Z = b of the interval [a, b\ 
and to the arbitrary collection of points g rj 

for each division, hi -- Xi — 

Restricting our consideration to a finite number of terms 
on the right-hand side of relation ( 1 ) and taking particu- 
lar values of the argument belonging to the interval [xi-^, 
Xi] as a collection of points we can get various formulas 
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for approximate integration. Thii.s, taking tlie values of 
the left-hand and right-hand endpoints of the interval 
Ixi-i, X,] as li, we get a formula of the left or right rectan- 
gles respectively {hi = i/n -- const): 

h n - 1 

/= j /(j:)dx^ (h — fl) 2 (2) 

a i— 0 

h n 

1=^ f {x)dx^(b — a) J; ^ fi = I,. (.S) 

a 

The names of these formulas are due to their geometri- 
cal interpretation. If we construct a curve y = j (x) in 

y 


Fig. 8.1 


I a b 

Fig. 8.2 

the j^'^-plane and divide the interval [a, b] into n parts 
hy the points Xi of the net Z),,, then the formula of the 
left rectangles yields, as an approximate value of the 
integral, the total area of tlie hatched rectangles shown 
in Fig. 8.1 and the formula of the right rectangles yields 
the total area of the hatched rectangles shown in Fig. 8.2. 
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Example 1. Using the formulas of the left and right rectangles, 

9 

calculate \ — ^ setting w — 4. 

A Knowing the int( 3 gration limits a — 1 and — 9, we find 
the step h = {b — a)/n = 2. Then Xq ~ 1, — 3, .r., = 5, 0:3 = 7 

and j *4 = 9 are the division points and the values of the integrand 
function / (x) = i/(x + 2) at these points are 

yo = f (*o) = 1/3, y, = / (ii) = 1/5, 

1^2 = / (^2) = 1/7, ys f (^3) = 1/9, !/4 = / (*4) = 1/11- 

Next we find the numerical value of the integral using formula (2): 
= + + + |-| h-J-) ^1-6'>24. 

Now if we use formula (3) to calculate the definite integral, then 
we obtain 

/r-^(i/.-|->/2 + J/2 + J/4)-2(-i I- 1 ^1.11153. A 

The rectangular formula^ where the midpoints of the 
intervals Xi] are taken as is tlio most widely used 
formula based on the ropresontalion of a dohnito integral 
as an intogral sum. For a uniform not (hi ~ h) this for- 
mula has the form 

h n 

/ = J / (a:) Tj fi-i/2 ^ /n, (4) 

a i -1 

wliero / (a:,- — -^) , rf,-a, h. 

We seek an expression for the remainder of the approx- 
imate formula (4). For our purpose, we niprosent I ho 
integral appearing on the left-hand side of rolalion (4) 
as a sum 



Assuming the function / (x) to bo twice differentiable, 
i.e. / £ C- [a, 6], we write, for the function / (.r), on each 
of the intervals Uf-i, :rj, Taylor’s formula with the 
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remainder in l^agrange’s form: 

/ (^) = //-i/2+ + 




r(r\ih 

( 6 ) 


lieplacing the function / on the right-hand side of relation 
(h) J)y its representation (0), we carry out the integration 
using the second theorem of the mean: 


5/(.). 


•«)-!- 2 fi- 


ll fim). 


Til € X,). 

Since the second derivative is continuous, there is a 
point I] g («, b) siicli that 


2 r(Tii)=«r(Ti)=-V-/"Oi)- 

Using tills relation, we linally obtain 

b n 

J / (x) d.T {h - rt) 2 4* • 

a 1=1 

Comparing formulas (4) and (7), we get an expression for 
the remainder in the quadrature formula (4): 

1/1 = /-/« = Kr (ri). (8) 

We can thus represent the estimate of the erroi of the 
quadrature formula (4) in the form 

b n 

Ai=- 5 f(x)(]x — {b-a) 2 1 - 1/2 <-^^^ 2 * (9) 

a 

where max \f" (x) | . 

[a» ft] 

The expressions for the remainder (8) and for the error 
(9) show that formula (4) is exact for any linear function 
since the second derivative of such a function is zero and, 
consequently, the remainder and the error are zero too. 


25-0104 
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We shall prove that the estimate obtained cannot be 
improved, i.e. that there is a function for which the error 
of computing an integral from formula (4) is exactly equal 
to the right-hand side of (9). For this purpose, we shall 
consider / = a:* as the function being integrated and apply 
formula (4) to it: 

^a + ^h)\ 

1-1 


Removing the brackets under the sign of the sum and 
carrying out the summation, wo obtain 


/n 


63_a3 

3 


(b — a) 


On the other hand, a direct integration of the function 
yields 

/ = j a:® di . 

a 

Setting up a difference of the exact value of the integral 
and its approximate value, we get the following expres- 
sion for the remainder: 

/-/„ = (h-a)-|-. 

Uol liming to the estimate of error (9) and noting that 
for the function the second derivative (and, conse- 
quently, Mg) is equal to 2, we get the same value for the 
error 


i.e. the estimate of error (9) is attained on the parabola 
y = This result can be extended to an arbitrary pa- 
rabola since the operation of integration is linear and 
formula (4) is exact for linear functions. 

Estimate (9) evidently does not take into account the 
errors of the calculation of 1^, The error reflects the 
diflerence between the exact formula of Newton-Leibniz 
and the approximate formula (4), i.e. is an error of the 
method. 
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Let us now estimate tlm error of the approximate value 
/yi- If the values of the function used in the quadrature 
formula have been obtained by an approximate method 
or, for some reason, the calculations cannot bo absolute- 
ly accurate, then a computing error and rounding er- 
rors occur. Assume, for instance, that the values /i-1/2 
in formula ( 4 ) have been calculated with the same abso- 
lute error e. Then the total computing error constitutes 

n 

Ag (6 — a) 2 ~ ® ^ — fl) e. (10) 

i=l 

Note a characteristic peculiarity of this error: it does 
not depend on the number of divisions of the integration 
interval but is only proportional to its length. 

1 

(* dx 

Example 2. Uso the rectangular formula to calculate ^ y' Y 

0 

setting n — Rstimate the error of the approximate value ob- 
tained. 

A From the given integration limits and the number of divi- 
sions n we find the stop: h • (1 — 0)/4 0.25. Next, from formu- 

la (4) we get 

(-S') +'(l) +'(!)+' (!■)]■ 

Calculating the necessary values of the function with tliree valid, 
in the narrow sense, digits (e — 0.0005), we obtain 

1 

[ -^ --0.25(0.889 -1-0.727-1-0.015 + 0.533) -=0.091. 

J 1 + a: 

0 

We use formula (9) to estimate the error of the method, for which 
purpose we first find the maximum of the absolute value of the 
second derivative of the integrand function: 

M 2 =^ max I 1= max - ^— ->^2. 

to. Ill + I to. 

Thus the error of the method is 

(1/24). 0 . 252 . 2 ^ 0.0053. 

Using formula (10), we find the computing error 
1-0.0005 == 0.0005. 


26 * 
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Consequently, we can take A = A| + Ag ^ 0.006 as the total 
error of the approximate value of the intofjral and write the final 
1 


answer 


1 


dx 

TT~x 


= 0.691 ± 0.006. 


0 


For the sake of comparison we give several digits of the exact 
value of the integral calculated: In 2 = 0.698147 .... A 

Example 3. Use the rectangular formula to calculate the into- 



dx 

1 + ^ 


with an accuracy of 0.001. 


0 

A .Vpplying the algorithm of the solution of Problem II from 8.3, 
we represent the total error as the sum of three terms: 0.001 ~ 
0.0009 0.00005 H- 0,00005. Next we choose n from the con- 

dition 






Af2< 0.0009. 


Solving this inequality with respect to n, for b -- a - \ and 
M 2 = 2, we get 10. 

We tabulate the values of the function i/(x 1) with four 
valid digits in the narrow sense: 

O.05 I 0.15 I 0.25 I 0.35 I 0.45 | 0.55 j 0.65 | 0.75 | 0.85 | 0.95 

) .9254 |o.8696|() .SOOOold .74')7|o .6897|o .6452|o .Ci)6l|9 .5714|(t .54()5|l) .5128 
Using the rectangular formula (4), we obtain 
7io = 0.1 (0.9524 + 0.8696 + 0.8000 + 0.7407 + 0.6897 +0.6452 
+ 0.6061 + 0.5714+0.5405+0.5128)=0.69284. 
Rounding off the result obtained, we have I = 0.6928 i 0.001. A 

The trapezoid formula. Let us consider now another 
method of constructing quadrature formulas connected 
with the approximation of an integrand function by an 
interpolating polynomial. We consider a simple case 
of approximation by a first-order polynomial with nodes 
at the points a and b: 

f(x) = f{a) + ^lf(b)-f(a)] + ix~a){x-b)-l^, 


lie (a. b). 

Integrating the right-hand and left-hand side.s of this 
relation and employing the second theorem of the mean 
to integrate the last term on the right-hand side, we 
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obtain 

b 

a 

Thus, assuming that the interval of integration is small, 
we get a quadrature formula known as the trapezoid 
formula: 

h 

/-^J f{x)i]x^-^[f{a) \ (11) 

(I 

with a remainder 

«2 [/) = /- h - - r (11), 11 € (a, b). (12) 

Using expression (12) for the remainder, we can represent 
tlie estimate of the error of the quadrature formula (11) as 

b 

A,-| J /(.r)dx-±^(/(a)-l /(ft))|<i^-^M2, (13) 

a 

wliere max [ f" (x) | . 

[a, b] 

The expressions obtained for remainder (12) and error 
(13) show that the quadrature formula (11) is exact for 
all linear functions since the second derivative of func- 
tions of tliis kind is zero and, consequently, the remainder 
and the error are also zero. 

13y analogy with what we have done for estimate (9), 
we can show tliat estimate (13) cannot be imptoved 
since it is attained on an arbitrary parabola. 

When forjuula (11) is used to estimate the computing 
error for the case, when the values of the function have 
been calculated with the same accuracy e, the estimate 
has the form 

A2<-^(Mf)-(6-a)e. (14) 

Note that I lie computing errors of (he quadrature for- 
mulas (11) and (4) are the same. 

Example 4. Use the trapezoid formula to calculate the integral 
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1 

J djr 

Estimate the error of the approximate value obtained. 

0 

A From formula (11) we have 

1 2 = 0.5 [/ (0) + / (1)1. 

Calculating the required values of the function, we get 
1 

j 0.5 (1 + 0.5) =0.75. 

0 

Wt find the error of the method from formula (13) using the 
value M — 2 obtained in Example 2: 

Ai<^.2^0.17. 

The computing error is evidently zero since the values of the 
function and /g have been found with the absolute accuracy. 

1 

Thus the final result is ^ = 0.75 + 0.17. ^ 


Note that in Example 4 we had a considerably less 
accurate solution than in Example 2. However, we must 
not draw a hasty conclusion since the use of the trape- 
zoid formula in Example 4 has some advantages. First, 
whereas the integrand function is given in the form of 
a table of its values at the nodes x,-, the use of the rec- 
tangular formula requires that the values of the function 
should be also found at the points Xi ± hl2, and this 
involves additional difficulties and errors. Second, in 
Example 4 the values of the integrand function were 
calculated at two points whereas in Example 2 this was 
done at four points, which naturally took more time. 

These arguments show that the importance of the 
quadrature formula is defined not only by the form of its 
remainder (the error) but also by other factors, the time 
taken by calculations, for one. 

Other kinds of the quadrature formula. Let us consider 
one more way of constructing quadrature formulas, that 
of representing the integral as a linear combination of 
the values of the integrand function and its derivatives 
at some nodes t,* followed by determination of the un- 
}<nown coefficients (weight factors). 
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Assume, for instance, that we are constructing a quad- 
rature formula of the following kind: 

h 

5 / (x) dx = (b-a) [AJ (a) + AJ (b) + AJ’ (a) + AJ' (6)1. 

(15) 

We find the weight factors (i = 1, 2, 3, 4) such that 
formula (15) is exact for arbitrary polynomials of degree 
zero, one, two and three. Since the operations of integra- 
tion and differentiation are linear, this condition is ful- 
filled if it is fulfilled for the polynomials i, x, and x^. 

Substituting these polynomials for / (x) in relation 
(15), under the condition of its exact validity, we ob- 
tain the following system of linear equations for Ail 

aA^ + iidg + A^ -f- Af^^ = “ 2 ” “1" ^) » 

a^A 1 H - h-A.^ + 2a A^ + 2b At^ ^ (d^ -|- H 6-), 

^ a^A^ -| h^A.^ -|- 1- W^Ai^ — (a? d^b 4- ab'^ + b ^) . 

Solving this system, we find that 

A, A,, - 1/2, A, - -A, = (b -tf)/12. 

Thus the required (juadrature formula has the form 

I = ^ f (.r) ilx ^ (b — a) fi^) + l 

+ (!-«) ( 16 ) 

We seek an expression for the remainder of this for- 
mula, for which purpose we represent the function being 
integrated as the sum of a third-degree Ilermite interpo- 
lating polynomial with two double nodes a and b and the 
remainder and then integrate the right-hand and left- 
hand sides of that representation on the interval fa, b]: 
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j /(a:)da:= j /r 3 (x)da: 4 - j ^ (ti) dx, 


Tig (a, b). 


The first term on the right-hand side yields the right- 
hand side of the quadrature formula (Id) since tliis for- 
mula is accurate for all third-degree polynomials and, 
consequently, for the Hermite polynomial (x) as well. 
The second term on the right-hand side yields an ex- 
pression for the remainder of formula (Ifi). Using the 
second mean-value theorem and carrying out the in- 
tegration, we obtain 

= n^{a,b). (17) 

The expression for the remainder we have obtained 
makes it possible to write the estimate of the error of the 
quadrature formula (16) in the form 

( 18 ) 

where Mi^ — max (x) | . 

^ [a, h] 

Estimate (18) cannot be improved since it is attained 
on an arbitrary fourth-degree polynomial. It is easy to 
prove this by analogy with what we have done for esti- 
mate (9). 

To estimate the computing error of the result, obtained 
from formula^ (16), we assume that the values of the 
function are specified with an accuracy of and the 
values of the derivatives with an accuracy of e^. Then 
the computing error is 

A2^(b-a)e, + -^^^e,. ( 19 ) 


Example 5. Use the quadrature formula (16) to calculate Iho 
1 

J dic 

. Evaluate the error of the approximate value 


obtained. 

A Calculating the required values of the integrand function 
and its derivatives with the use of formula (16), we find that 




1 


-1 I 0.25> 

12 J 


= (».6B75. 
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We use formula (18) to evaluate the error of the inelhod, for 
which purpose wc first find the maximum of the absolute value of 
the fourth derivative of the integrand function M 4 = 24: 

Ai< 4^.24^0.034. 


The computing error is evidently zero since the values of the lunc- 
tion and those of the derivatives have been calculated with the abso- 
lute accuracy. 

Thus, rounding off the approximate values of the integral and 

1 


the error, we finally 


obtain \ ^ ± 0.04. A 

J \ + X 


0 


Up till now, ill all the quadrature foriiiuJas wc have 
considered, the quadrature nodes were lixed. VVe shall 
now consider tJic case when the position of all the nodes 
as well as all tlie weight factors are assumed to be free 
pararaclers. For the compulations not to be very com- 
plicated but at the same time not trivial, we shall seek 
the value integral in the form 


h 

J /(X) clx- {b-a) [AJ(x^) + A,fix,)\. (20) 

a 


To determine the four free parameters A 2 , and 
d' 2 ^ we require that formula (20) should be absolutely 
accurate for all polynomials of ilegree zero, one, two 
and three. Uy virtue of linearity of the o[)eration of in- 
tegration and the right-hand side of relation (20), for 
the quadrature formula (20) to be exact for all third- 
degree polynomials, it is necessary and sufficient that 
it be exact for the functions 1, jt, ur and .r\ Consequently, 
there must hold relations 


1 

J -J *^ 2 *^^2 — ^ 

I xtA^ “ 4" 

xlA^ + x^A, -= (a^ a-b + ab^ + 
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which constitute a nonlinear system of equations with 
respect to the parameters Xj, Xj, and Ag being de- 
termined. 

The solution of this system is 



^ 6-fo b — a 1 _ 6-fo , b—a 1 

2 2 Va ’ 

( 21 ) 


Thus the quadrature formula (20) assumes the 

b 


a 


/ 6 + 1 

b-a 


\ 2 ^ 

^ 2 

/3 iJ 


form 


( 22 ) 


Formulas of the kind when not only weight factors 
but also nodal points are not hxed in advance are known 
as Gaussian formulas. 

We seek an expression for the remainder of formula 
(22). For this purpose we represent the function being 
integrated as the sum of a third-degree Hormite inter- 
polating polynomial with two double nodes Xj and Xjj, 
defined by relations (21), and the remainder. Integrating 
the right-hand and left-hand sides of this representation 
on the interval [a, &], we obtain 

j/(x)dx^ j//3(x)dx-H j 

a a a 

b). 

The first term on the right-hand side yields the right- 
hand side of the quadrature formula (22) since this 
formula is exact for all third-degree polynomials and, 
consequently, for //g (i:) as well. The second terra on 
the right-hand side yields the remainder of formula 
(22). Using the second theorem of the mean and car- 
rying out the integration, we have 

= &)• ( 23 ) 
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Consequently, the estimate of the error is expressed by 
tlie relation 


(24) 


where M 4 =:xnax |/^ {x)\. 

[a, b] 

The estimate obtained cannot be improved since it 
is attained on an arbitrary foiirth-degi’oo polynomial. We 
can easily show this by means of direct computations as 
we did for estimate (9). 

If the values of the nodes in formula (22) are practically 
exact and the values of the function have been found 
with an absolute error e, then we shall get the same ex- 
pression for tlie computing error with the use of formula 
(2) as for the computing error with the use of formulas 
(4) and (11): 

(6 - a) e. (25) 


Example 6. Use the quadrature formula (22) to calculate the 
1 

S (\x 

. Evaluate the error of the approximate value 

0 

obtained. 

A First of all we hiid the nodes of the quadrature formula: 



(l — - 1.2113249 
+ I -0.7886751 



Having calculairnl the required values of the integrand function 
with an accuracy to within three valid digits in the narrow sense, 
we use formula (22): 


^ (0.826 ^ 0.559) -0.6925. 


We find the error of the method from formula (24), for which pur- 
pose we use the value of the maximum of the absolute value of the 
derivative — 24 found in Example 3: 


= 4320 


24^=0.0056, 
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We can find the computing error from formula (24) taking into 
account that the accuracy of the calculation of the values of the 
function being integrated is equal to 0,0005. 

Thus the total error is A = Aj -f Ag = 0.0061. 

Finally, rounding off the approximate value of the integral, 
1 

we have f = 0.692 =fc 0.007. 

J 1 + 

0 

The main purpose of this section is to show by simple 
examples how to derive various formulas of numerical 
inte'Tration. We have not naturally considered all the 
metiiods of constructing formulas. All the same, the 
examples given are typical so that using them, the stu- 
dent can construct a specific quadrature formula whicli 
suits best of all the practical problem posed. 

8,5. Newton-Cotes Quadrature Formulas 

In this section we discuss formulas of numerical inte- 
gration which are more complicated in structure. Up till 
now we considered interpolation methods of numerical 
integration including, in a definite sense, the rectangular 
formula. This means that the integrand function was ap- 
proximated by an interpolating polynomial. If the func- 
tion being integrated is smooth enough and the interval 
of integration is finite, we can get sufficiently good 
results. On the other hand, it is hardly possible to at- 
tain a close -approximation of a function by a polynomi- 
al if the function itself or its derivatives of low orders 
have peculiarities. In such cases it is expedient to re- 
present the integrand function as the product of two 
factors p (x) f (jr), which must possess the following 
three properties. First, the weight factor p {x) must reflect 
all the peculiarities of the function being integrated and, 
second, the moments 

h 

\ p {x) Ax (/i;--0, 1, ...), (1) 

a 

where Wjh] is an integration interval, must be calculated 
by anali^ical methods. Third, the error of approximation 
of the function f (x) by a polynomial must be small- 
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Let us now construct the quadrature formulas them- 
selves. We shall construct them in the same form as before; 

b n 

/ = J p (a:) / (x) (\x ^ (6 — a) 2 ^tf i^t) = (2) 

a i=i 

[n the general case, as we mentioned before, formula (2) 
has 2fi free parameters which are the quadrature nodes 
xi and the weight factors Af. We assume the number n 
to be iixed. The choice of free parameters is defined by 
the same requirements that are imposed upon a quadra- 
ture formula by the conditions of a practical problem. 
These requirements may be, for instance, the maximum 
possible accuracy, the minimum computing error, the 
fixing of some (and, maybe, all) weight factors or quadra- 
ture nodes. 

We begin with a relatively simple case when the nodes 
are specified in advance and we can vary only the choice 
of the weight id'Aors Ai. The idea of interpolating quadra- 
tures is tliat we approximate the function / by an inter- 
polating polynomial in Lagrange’s form of degree n — 1 
using n different nodes Xi'. 

f (^) = ^n-l + Jin-1 (^). 

integrate the riglit-liand and left-hand sides of this re- 
lation on the interval fa, b] first multiplying them by the 
weight function p (a;): 

b b h 

jj p (a:) / (X) dx = J p (x) (x) (lx + )j p (x) /?„_i (x) dx, (3) 

a a a 

and transform the first term on the right-hand side of this 
relation, for which purpose we replace by its explicit 
expression and interchange the operations of integration 
and summation: 

I p(^)/w<i^= s ( I p{^) 

i=l a 
n 

Here (i)„_i(x) |f (x — x^). Tho first factor under the 

sign of the sum is numerical coefficient which is pro- 
portional to the length of the integration interval and 
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depends only on the position of the nodes and the prop- 
erties of the function p (j:) (hut not on the function /). 

Assuming now that the second term on the right-hand 
side of relation (3) is small, we get the approximate quad- 
rature formula (2) with the specified nodes Xi and coef- 
ficients Ai defined as follows; 


p(^) 2, .... n). (f)) 


The quadrature formula (2) thus constructed is known 
as an interpolation formula. 

Let us now estimate the error of formula (2) witli coef- 
ficients (5). To do this, we integrate the remainder of the 

interpolation formula {x) ~ 

stituting this expression for (./) into the second terra 
of relation (3), we obtain 

Hn-i = 5 P o\-i (*) (ii) f'af, ^ e («. b). 


If the function / has a continuous derivative of order 
n on the interval of integration and the product 
P (•^) ^‘>71 (x) retains sign on this interval, then wo can 
get the following expression for the remainder: 

b 

Rn-i If] = — ^ 1 ^^^ P (a:) ®n-i (*) 11 e (a, b), (6) 


and, consequently, the estimate of the error of the quad* 
rature assumes the form 


b 



a 


P (a:) «n-! (*) d® , 


( 7 ) 


where A/„ = max |/(">(j:)|. Under the conditions indi- 

[a, b] . , , 

cated above this estimate is the best. 

Now if the product p (z) o)„_i (z) does not retain sign 
on the integration interval, then we got only a rough 
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estimate of the error V IpW 

a 

which may turn out to be far from the optimal one. There- 
fore, in such cases other reasons are taken into con- 
sideration when an explicit expression is constructed for 
the remainder and the error. We shall discuss one of these 
techniques later on when we study Simpson’s rule. 

Example 1 . Construct tho quadrature formula (2) for the inter- 
val [— 1, 1] with nodes = — 1, Xg = 0, jTg = 1 and a weight 
function p (x) = (1 — x*)*V2. 

A In essence, we have to determine the coefficients (i ^ 1, 
2, 3) appearing in formula (2). Using expression (5) for the required 
coefficients, we have 

o>i _ f (^ — ^)(^ — 1) dx JT 

1 

o>i _ f — 1) dx JI 

j hi)(d-i) • /r=T2 2 ’ 

r (x-|-l)(x— 0) dx JI 

Thus the required formula has the form 
1 

Example 2. Construct the quadrature formula (2) for the liter- 
val [0, 1] with nodes xj ~ 0, Xg 0.5, x., 1 and weight function 

p (x) — In X. 

A As in the preceding example, we use formula (5) to find the 
coefficients: 


- f- (a:_0.5)(x-l) , 


17 

36 



In X 


{x-0){x-l) 
(0.5— (»)(0.5 — 1) 



In X 


(*— 0)(x— 0.5) 
(1-0) (1-0.5) 
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Thus 

1 

^ In j: / (.r) dx 

b 


-4-l<7/(n)+20/(n.5)-/(i)]. A 


Note the characteristic features of the examples consid- 
ered. In Example 1 the symmetry of the nodes and the 
evenness of the weight function with respect to the mid- 
point of the interval led to the symmetry of tl\e coef- 
licicnts of the quadrature formula. In Example 2, despite 
the symmetry of the nodes, the symmetry of the coef- 
ficients is violated, which is the consequence of the 
absence of symmetry (evenness) of the weight function. 

In practical computations of especial interest is the 
case when the nodes of the quadrature formula are given 
as equispaced points of the interval [a, Xi — 
a |- (i — 1) (i = 1, 2, . . n) and tlie weight 
function p ( 2 ) is identically equal to unity. On these 
assiirnplions we can transform formula (2) as follows: 

h n 

J / (x) — if I . (8) 

a 


For different n we get different quadrature formula!^ of 
Newton-Coteff. The coefficients Hi known as Cotes" coeffi- 
cients can be found from relation (5): 


Hi-Ai 


(- 1 )"- 


(n-l)(i-l)!(n-i)! 


It 


(t — 1) ... (t — n) 
t — i 


(l^ 


n>l, i = l, 2, n; 01 = 1. 


(9) 


These coefficients possess the following properties useful 
for calculations. 

1°. The symmetrical coefficients {the first and the nth, 
the second and the {n — i) th, . . .) are equal to one another: 

H i = 


□ We replace i in expression (9) by w + 1 — 


H 


n+l-i ■ 


(- 1 )*-^ (* 0 - 1 ) Af 

-l)(n-01(i-l)I .! t-n — l + t 
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Passing to a new variable q ^ n + \ —t under the in- 
tegral sign and carrying out simple Imnsformations, we 
obtain 


ffn+i-i 






and Ibis coincides with expression (9) for the coefficients 

■ 


2°. The sum of all Ihe coelficients is equal to unity: 

n 


2//i = i. 

i=l 


□ The validity of this property follows immediately 
from formula (8) if wo set / {x) 1 since the remainder 

of this formula, defined by expression (0), is zero for 

/ W -- 1. ■ 

Table 8.1 gjvos the values of Cotes’ coeflicients for 
n - 2, 3, fj, C). 

Table 8J 



We shall consider in more detail a significant special 
case of the quadrature formula (8) resulting at n = 3. 
To construct this formula, we could use the data from 
Table 8.1 hut we shall perform the requisite calculations 
by way of an example. Employing formula (9), we obtain 

3 

".’'-Sf-.'i ('-2)((-3),I( 4 . 


26-0104 
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Next, using relation (10), we find that 

III = ffi ^ //a = 1 - {Ih I fU) ^ 2/3. 

Thus the required quadrature formula, known as 
Simpson's formula, has the form 

b 

/ s 5 / (x) da: s -?^ [/ (fl) + 4/ ( -4^ ) + / (/>) ] ^ /3. 

( 11 ) 

Bv virtue of its construction (approximation of tlio 
integrand by a second -degree polynomial), this formula 
is exact for all polynomials of degree zero, one and two. 
We could try to obtain an expression for the remainder 
directly from relation (fi). However, Simpson’s formula 
possesses the so-called property of increased accuracy 
meaning that it is exact not only for second-degree poly- 
nomials but also for third-degree polynomials. Since 
the operation of integration is linear, it is sufficient to 
establish an exact equality of the right-hand and left- 
hand sides of formula (11) for the simplest third-degree 
polynomial in order to prove this statement. Indeed, 
calculating the left-hand side of formula (11) for / ™ 
we have 

5 x^d3:== 

a 

On the other hand, calculating the right-hand side of 
formula (11), we obtain 

and this is what we wished to prove. 

We shall take advantage of the statement we have 
proved to construct the remainder of Simpson’s formula. 
We represent the function / as the sum of Hermite’s in- 
terpolating polynomial with simple nodes a and h, a 
double node (a + ^^)/2 and a remainder 


4 ^ LT f 


a-\-h \ 


2 


(if) 
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Wo integrate llie riglit-liand and loft-liand sides of tliis 
relation on the interval la, h\. By virtue of what we 
have just proved, the integral of llermite’s polynomial 
yields the right-hand side of formula (11) and the inte- 
gral of the second term yields its remainder 

n,[f] b). ( 12 ) 

Consequently, we can represent the estimate of the error as 




(6 — a)5 


where yi/4 -- max | (j;) |. This estimate cannot he 

[aM 

improved since it is attained, say, for the function / — 

Example 3. Use Simpson’s rule to rahulote tlic integral 
l 

5 (1 jT 

-pj-- . Estimate the error of the approximate value obtained. 
0 

A Calculating the needed values of the integrand at the points 
xi 0, X 2 - 0.5, x^ — 1, we substitute them into formula (11): 

/a - ( i -h 4 • I > .007 + < t .5) - 1 » .0047 . 

Taking into account that - max I ( f ) 1—24 and using 

[ 0 , I 

formula (13), W(' find that the error of the method A, ^ 0.0084. 
Let us find the computing error: 

As < ~ (' » + 4 • 0.0005 + 0) = 0.00034 . 


Adding the errors together and rounding off the result, we ob'waiii 
1 

[ 7^=0.095 ±0.01. 4 

j ti * 

0 

The property of increased accuracy described above is inherent 
in all quadrature formulas of type (8) constructed with the use of 
an odd number of nodes. This property is a direct consequence of 
the “symmetry” of the quadrature, i.e. the equality of the symmetric 
coefficients Hi — and the linearity of the operation of 

computing the value of a function and that of integration. To 
obtain a precise estimate of the remainder of such a formula, it is 
necessary to approximate the integrand by Hormite’s interpolating 
polynomial with a double central node. 

Returning to the quadrature formula (2), wo can state that 
when the coefficients are symmetrical (.4 1 ~ A ^+ 1 -/) and the wcdghl 
function is even, this quadrature constructed with the use of 2k *|- 1 


26 * 
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nodes is exact for all polynomials of degree 2k + i since it is exact 
for any function / which is odd with respect to the midpoint of the 

6 

interval of integration. Indeed, on the one hand, ^ p (:r) / (.r) dx — 

n 

2 / 14-1 

0 for functions of this kind, and, on the other hand, ^ “ 0 

by virtue of the symmetry of Ai and the oddness of /. 

Example Using the quadrature formula constructed in 

1 

5 * cos 2C djj 

I and estimate the 

_l Vi-x^ 

error. 

A We calculate the needed values of the function / -= cos x: 
cos (—1) — 0.540, cos 0 " 1, cos 1 — 0.540. Substituting these 
values into the quadrature formula, we have 


co s J dr ^ -i(0.54<1 + 2. 1+0.540) = 2.419. 
Vi—X^ 4 


We seek now an expression for the remainder of the quadrature 
formula given in Example 1. Since the weight function is even and 
the nodes arc symmetric and odd in number, this formula possesses 
the property of increased accuracy, i.e. it is exact for all third- 
degree polynomials. Therefore, by analogy with what we did for 
Simpson’s formula, we use Hermite’s interpolating polynomial with 
a double central node ~ 0 and get the following expression 
for the remainder: 


Hsin^ 


4! 


r (j+i) 1) IV 

J 192 ^ 


(11); 


'nG(— 1, 1). 


Consequently, the error of the method is 

Ai^^; max I cos a: 1 =0.017. 

^^^[-1. 1] 

Next, since we have calculated the first and the third value of 
the cosine with an error of 0.0005 and the second with an absolute 
accuracy, we get the following expression for the computing error: 

Aj < i (0.0005 + 2 -0 + 0.0005) = 0.0008. 

Summing up the errors and carrying out the necessary roundings- 
otf, we finally obtain 

( -£^^ = 2.42 ±0.02. A 

J V^l-x» 
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In conclusion we shall discuss one more technique of 
determining the coefficients Ai appearing in the quadra- 
ture formula (2) with specified nodes. We require that 
formula ( 2 ) should be as accurate for the functions 1 , x, 
... as possible. In this case, we get the following 
system of equations for the coefficients A^: 

7n„ = (i-a)|3 xUi (k-^0, 1, N). (14) 

i=l 

If the nodes Xi do not coincide and N n — then 
Ihe determinant of system (14) is a Vaiiderinonde de- 
terminant and the solution of this system (the collection 
of coefficients Ai) exists and is unique. 

We shall prove that such a method of determining quad- 
rature coefficients is equivalent to that described above, 
i.e. that formulas (5) yield the same values for^,- as sys- 
tem (14). To prove this fact, we substitute expressions 
(5) for tJie coefficients A i into the right-Iiand sides of eijua- 
tions (14) and interchange the operations of summation 
and integration: 

h n 

= i* p (x) r ^ ■ xj 1 dx. 

h ) \ /LiCJ (I — M 

a i— 1 

TJie expression in brackets is Lagrange’s interpolating 
polynomial of a degree not higher than n — 1 for the func- 
tion x^^ (k < n). The remainder of such a polynomial is 

71 V 

(o,'*) =0 for k a nj, and therefore 

b 

^ p (x) j;'* d (fc^O, 1, ...,n— 1). 

a 

It follows from the identities obtained and the uniqueness 
of the solution of system (14) that both methods of con- 
structing the quadrature formulas ( 2 ) are equivalent. 

By way of an example, we shall construct a quadra- 
ture formula of the form 

b 

J fix) dx ^ (/;-a) [.!,/' (a) A,f ( 4 ,y’ (/,)] . 
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To construct such a quadrature formula, wo require 
that it should be exact for all polynomials of degree 
zero, one and two. For this purpose, by virtue of the 
linearity of the operations of integration, calculation of 
the values of the function and diHercntialiou, it is suf- 
I'lcicnt to require that the quadrature formula should be 
accurate for 1 , x, x^. Thus let / (x) = 1 and then 

(6 — fl) = (6 — a) (.di'O -|- A-i'i + .ds'O), i.e. — 1. 

Assume now that / (x) = x and then 

i.e. Ai^-A,. 

Finally, setting / (x) - x^, we get an equation 

+ ..A,-2a+i-(^^Y-Ar2b, 

solving which we liiid that A,-^ — ~24~' 

Thu.s the’ required formula has the form 

b 

/= \ /(x)dx 


+ ((.-«)/ ( 6 )] = /,. 

Note that this formula also po.ssesses the projierty of 
incrca.sed accuracy as, for instance, Simpson’s formula. 
Here we give, without deriving, the o.\pre.ssion for the 
remainder of the formula obtained 

nAn-i-h--^(b-a)^r{n), b). 

We invite the reader to prove the last relation indepen- 
dently as an e.\ercise. 
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8 6. Quadrature Formulas of the Highest Algebraic 
Degree of Accuracy 

We again consider the quadrature formula 

b n 

/=jj i){x)f(x)([x^(h-a)^ Aif{xi)=I„. (1) 

a i=l 

As WO have noted, in the general case not only the 
coefheients Ai but also the nodes Xi are arbitrary para- 
meters that must be determined in accordance with the 
requirements which relation (1) must satisfy. Since the 
total Ji umber of free parameters is 2/z, we can expect 
that imposing 2n conditions on relation (1), we shall 
get a system of equations for determining these para- 
meters. We can certainly not find out for sure, in the gener- 
al case, whether the system has a solution at all, and if 
it lias, then whether it is unique. We can answer these 
questions only after considering the concrete require- 
ments the quadrature formula (1) must satisfy. It is evi- 
dently expedient to connect these requirements with the 
value of the error of formula (1) and to try to choose the 
nodes and the coeflicienls so as to minimize, in a certain 
sense, the absolute value of the remainder. We pointed 
out in the preceding section that the estimates of the 
errors of the quadrature formulas were attained on poly- 
nomials wliose degree exceeded by unity the maximum 
degree of the polynomial for wliich the corresponding 
quadrature was exact. It is natural tlierefore to trv and 
increase the degree of the polynomial for which formula 
(2) would he absolutely exact. Such a posing of the 
problem generates the following optimization prob- 
lem. 

We have to construct a quadrature formula of type (1) 
with a lixed /?, accurate for an arbitrary polynomial of 
degree r as high as possible. 

We shall show that this problem is equivalent to the 
problem of constructing the quadrature formula (1) 
which is accurate for all functions {k — 0, 1, . . ., /). 
Indeed, assume that we have an arbitrary polynomial 
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Pj. (a:) = S Then 

ft =0 

r b n 

= 2 a* ( 5 (► (-r) a-'* dx - 2 ^i4) 

A=0 a i=l 

r 

= 2 «ft«n[a:'*]. (2) 

A=0 

From this, by virtue of the arbitrariness of al^ (the poly- 
nomial Pj. is arbitrary), we find that for [PJ = 0 it 
is necessary that /?„ [x*] =0 (A: = 0, 1, . . ., r). The 
sufficiency is a direct consequence of the linearity of the 
remainder of formula (1) with respect to the function / 
and is obvious by virtue of the same relation (2). 

We thus arrive at a system of r -|- 1 equations for 2n 
unknown parameters At and Xii 

h ‘ n 

^ p(oc)x^Ax--^{b — a) 2 (fe = 0, 1, ...» r). (3) 

a 1-1 

It is natural to try and solve this system, i.e. construct 
a quadrature formula for r -f 1 = 2A^ (the number of 
equations is equal to the number of unknowns). The tlieo- 
rems presented below substantiate the expediency of 
this attempt. 

We shall first formulate without proof an auxiliary llieo- 
rem which characterizes the properties of orthogonal 
polynomials. 

Theorem 1. Assume that: (1^) p (x) >0 almost everywhere 
on [a, 6], (2°) Pn-i (•^) arbitrary polynomial of de- 

gree not higher than n — 1. Then there is a polynomial 

^ 71 i^) = ^l) *^ 2 ) ■ • ■ ‘^ 7t) (^) 


orthogonal to P^-i (x) with weight p (x), i.e, such that 

b 

Jp(x)’F(i)/V,(a:)dx = 0, (5) 
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all its roots Xg, ...» being distinct and lying within 
the interval [a, 6], and this polynomial is unique. 

We shall now consider theorems which make it possible 
to find directly the nodes and coefficients of formula (1) 
which is accurate for all polynomials of degree 
r = 2n — 1. 

Theorem 2. For formula (1) to be accurate for polynomi- 
als of degree 2n — 1, it is necessary and sufficient that: 
(1^) the nodes x^ be roots of the polynomial T’y, defined by re- 
lation (5), (2°) the weight factors At be defined by relation 
(5) from 8.5. 

□ We begin with the necessity of conditioji 2"'. If 
formula (1) is accurate for all polynomials of degree 
2A^ — 1, then it is also accurate for polynomials of any 
lower degree, the degree n — 1 inclusive: then this for- 
mula is interpolating and we get a unique collection of 
coefficients Ai deiined by formula (5) from 8.5. 

L(^t us consider a polynomial ^ 2^-1 == 

Using the t that formula (1) is accurate for the poly- 
nomial Q 211^1 (^), we obtain condition 1°: 

h n 

5 P W “n-l {^) K-l W <• 3 ' =- {(> — «) 2 i^i) 0- 

a i—i 

The last relation follows from the fact that m,i-i(x,) 0 

for all i = 1, 2, ...» n. 

We sliall verify the sufficiency of conditions 1 and 
2’. We represent the arbitrary polynomial ^^ 271-1 (•^‘) 
of degree 2n — 1 as 

C^2U-1 “ (’^) ^n-i 

where P„^i and S are the quotient and the remainder 
of the division of the polynomial Q 2 U -1 by the poly- 
nomial respectively, Pn-i being a polynomial of 
degree n —1 and a polynomial of degree not 

higher than n —1. Next we have 

h b h 

( p(^)^ 2 n-iflj;= ( p(a) dx+ J (.(x)5„_,clx. 

a a a 

The first term on the righl-haud side is zere by virtue of 
the orthogonality of and P„_j (condition 1°) and for 
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the second term formula (1) is accurate by virtue of con- 
dition 2\ Therefore, taking into account that Q^n^i (r.i) == 
i-^i) since (i:^) = 0, we finally obtain 

b n 

5 P(a:)(?2n-ida: = (fe — a) 2 (a:/)- ■ 

a i=i 

The next question is whether it is possible to construct 
the quadrature formula (1) accurate for all polynomials 
of degree higher than 2n — 1. The following theorem 
amvvers this question. 

Theorem 3. Let p ( 2 :) >0 almost everywhere on [a, b\. 
Then there is no quadrature formula of type (1) accurate 
for all polynomials of degree 2n, 

□ We consider a polynomial ^ 2 n ^ 1 )'^ ••• 

(x — — Then the left-hand side of relation 

b 

(1) is ^ p(x)(oifj_j(x)dx>0 whereas its right-hand side is 

a 

S (*i) -- 0* this proves the theorem. ■ 

i— 1 

Thus the quadrature formula (1) with nodes Xi delined 
by relation (5) and coefficients Ai defined by relation 
(5) from 8.5 is accurate for any polynomial of degree not 
higher than 2n — 1. It is known as a quadrature formula 
of the highest algebraic degree of accuracy (or the Gaussian 
quadrature •formula). 

The Gaussian formula possesses a property useful from 
the point of view of computing error: all coefficients 
(t = 1, 2, . . ., n) are positive for any n. 

To prove this statement, we consider a function 

[ which is a polynomial of degree 2n — 2 and 

which vanishes at all nodes Xj Xp. The Gaussian for- 
mula is accurate for this function aJid therefore 

b 

a 

It follows immediately that Aj, >0. Since p is arbitrary, 
all quadrature coefficients Ai evidently exceed zero. 
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Wu shall now estimate the error of the Gaussian quad- 
rature formula. 

Theorem 4. Assume that: (1"') p {x) >0 almost every- 
where on [a, 6], (2“) f (x) ^ [a, 6], (3°) xi and At 

(i = 1, 2, . . n) are the nodes and the coefficients of 
the Gaussian quadrature formula respectively. Then there 
is a point ^ ^ (a, b) such that 

b 

/„ 5 (> (X) (X) dx. (6) 

a 

□ We represent the function being integrated as 

/(x) (x)-l-^J^^<.i(x), tie (a, b), 

where i/an-i W llerniitian interpolating poly- 

nomial of de<n*ee not Ijigher than 2n — 1 with double 
nodes Xi (i ~ 1, 2, . . n). Evidently, the Gaussian for- 
mula is exact for (x). Therefore 

h 

1 ^^In + -( 2 ^ \ C (-r) /<-'*’ (^) w;,.i (a:) di. 


Applying tJie second theorem of the mean to the second 
term on tlie right-hand side and transferring /„ to the 
left-Jiaiid side, we get the required relation (0). g 

In practice, the Gaussian quadrature is usually ob- 
tained as follows. We lirst find the roots of the polynomial 
4^,1 (x) which is orthogonal to all polynomials of degree 
lower than n. Then we construct a system of linear equa- 
tions for the coefficients Ai assuming that the quadrature 
formula is valid for the funclions 1, x, . . ., 

b n 

rnJ^ = p(x)x'*dx-- ^ Aixf. 

a i=l 


Solving this system, we find A^. 

Formula (22) constructed in 8.4 is the simplest illustra- 
tion of the Gaussian quadrature. 
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8.7. Compounded Quadrature Formulas 

Formulas with a large number of equispaced nodes are 
not widely used. There are various reasons for tJiis. First, 
for functions which have a singularity not on the integra- 
tion interval itself but in its vicinity, the remainder of 
a quadrature formula of a high order is large, as a rule. 
And what is more, when the nodal points are equally 
spaced, even for some analytic functions, it is possible 
that i? „[/]=/-/„-> oo as n cs: . Second, for 
10 there are negative coefficients among Hi, and this 
lead.^ to an essential increase in the expected computing 
error. Indeed, assume that all the values of the func- 
tion appearing in formula (8) from 8.5 are given with 
the same accuracy e. Then we can estimate the total coni- 

n 

puling error by the quantity Aj = (b — fl) e S \ \- 

i=l 

Since the sum of all Cotes coeflicients is equal to unity, 
it follows that if tliere are negative coefficients among 
them< the value of Ag is increased. Table 8.2 demon- 
strates the rate of growth of Ag. 

Table 8.2 


n 

10 

15 

1 

20 

S 1^4 1 

»3 

«8 

«560 






Formulas of the Gaussian type possess definite advan- 
tages as compared witli the Newton-Cotes formulas since 
they are free from the drawbacks described above. How- 
ever, being formulas of the highest algebraic degree of 
accuracy, the Gaussian formulas have, for large n, a 
remainder which is proportional to the derivative of 
the function being integrated whose order is high. This 
is an essential drawback as concerns the integration of 
functions which do not possess continuous derivatives 
of higher, orders or of empirically constructed functions. 
Besides uiis, even for convergent quadrature processes 
constructed by means of Gaussian formulas it is usually 
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not known in advance how high n must be for the conver- 
gence to begin in practice, i.e. it is not known in advance 
how high n must he for the required accuracy to be en- 
sured. 

For these reasons, the so-called compounded {generalized) 
formulas are usually preferred in practical calculations. 
The essence of these formulas is that the interval of in- 
tegration [a, b] is divided into several subintervals, 
some quadrature formula with small n is applied to each 
subinterval and the results are added together. 

The expediency of such an approach is based on the 
following arguments. For many quadrature formulas, 
including those considered in this chapter, the remainder 
is proportional to the power of the length of the inte- 
gration interval. Assume, for instance, that the applica- 
tion of some chosen quadrature formula to the interval 
[flf, /;] yields the following expression for the remainder: 

-a)\{a, b), (1) 

where (p (a, b) is a slowly varying function of the inte- 
gration interval. 

Dividing the original interval into m equal subinler- 
vals and applying the same quadrature formula to each 
of them, we find that on each subinterval the remainder 
is approximately m^ times as small as in (1). Adding to- 
gether the results of integration and the remainders, 
we find that the error of the original integral is approx- 
imately times as small as in the case when we 

apply the chosen quadrature formula to the whole ori- 
ginal interval. 

This method is general enough and may be realized for 
any quadrature formula. 

The rectangular formula (4) with remainder (8) consid- 
ered in 8.5 is the simplest example of a compounded 
quadrature formula. 

We shall discuss compounded formulas which are most 
frequently used and which are based on the simplest 
quadratures presented earlier. 

Compounded trapezoid formula. Assume that we have 
to calculate the integral of the function / on the interval 
fa, &]. We divide the interval [a, 6] into m equal subin- 
tervals with boundary points a = Xq, Xy, , . x^ = b 
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so that the length of each subinterval is h = (b — a)/m. 
We represent the integral as (he sum 

ft *1 ijs *m 

^ f{x)Ax^^ f(x)dx+ f{x)dx+ .. .+ jj f{x)Ax 
'« *0 *1 

and to each term on the right-hand side of this relation 
apply the trapezoid formula with a remainder [see rela- 
tions (11) and (12) in S.hJ. Collecting terms, wo obtain 

6 m - 1 

a t=l 

m 

2 /"(n/). ^i€(a:i-i. a:,). (2) 

i=.l 

Assuming that the second derivative of tl)e function being 
integrated is continuous throughout the interval la, bl, 
we have, by virtue of Weicrstrass’ tlicoreiii, 

m 

'Z f''(r]i)-=mf{r]), r]^{a, b). 

Substituting this expression for the sum into relation (2), 
we get a compounded trapezoid jormula 

/s5/(a:)dx--^(i2:^+2 (3) 


with a remainder 




12m2 / lU;- 


Consequently, we can represent the estimate of the error 
of quadrature (3) in the form 


where A/g = max | f (x) |. The estimate obtained can- 

[a. b} 

not be improved since it is attained, say, on the parabola 
/ = x'^, which fact can be proved by a direct verification. 
Note that we have performed similar calculations when 
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we analysed the quadrature formula (4) in 8.4. See how 
this can be done for the compounded formula (3). 

We calculate the left-hand side of the quadrature 
formula (3) for / = 


We calculate the sum: 


h — a 


m - 1 


[^+3 


i=l 

Transforming the expression in brackets and using the 
following formulas for summation: 


m - 1 7fi - 1 

2 i — ^ 

i=l “ i=l 

we get the required quantity 

b^-a? (b-ay 
2 3 ’ r.m2 • 




(m — \) m (2m — 1) 
0 


Thus the error of the quadrature formula (3) for the 
function f — is 




(b-ar 

6ma » 


and this exactly coincides with the right-hand side ol es- 
timate (5) since M 2 = 2. 

Since the operations / If] and [/I are linear and 
formula (3) is accurate for any linear function, we can 
assert that estimate (5) is attained on a second-degree ar- 
bitrary parabola. 

Expression (5) for the error of the method of the quad- 
rature formula (3) shows that lim A^ = 0, i.e. increasing 

Tn->oo 

m, we can ensure any preassigned accuracy in the 
sense of the error of the method (when there is no com- 
puting error). In such cases we say that the method is 
convergent. It remains to find out how the error of the 
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initial data (the values h of the function) affects the 
error of the result. Since the right-hand side of the quad- 
rature formula (3) is linear with respect to the values of 
the function being integrated, the total computing error 
is proportional to the error of calculation of each value 
of the function (provided that they are equal). We can there- 
fore expect that when the initial data are sufliciently 
accurate, the total computing error will be sufficiently 
small. 

We shall derive formulas for the number of divisions 
m and the permissible error of each value fi of the func- 
tion, which ensure the required accuracy e when use is 
made of the quadrature formula (3) with error (5). 

First of all, using the algorithm of solving Problem II 
given in 8.3, we represent e as the sum e = + Cg -t- 

£3 (if, for instance, e == 10“*, then we usually sot 
e‘ - 0.3-10-*, = 0.2-10“*, £3 0.5.10“*). 

Next we choose the number of divisions m for which 
the inequality Ej will be satisfied. For this purpose, 

by virtue of (5), it is sufficient to require that 


12m2 


< ei. 


Transforming this inequality, we get the following for- 
mula for the number of divisions: 

• m > (6-a) . (0) 

Thus the error of the method does not exceed if the 
number of divisions m satisfies inequality (0). 

Let us find out what must be the error of the values of 
the function being integrated for the total error of calculat- 
ing from formula (3) not to exceed Eg. Let the required 
error be A [//]. Then, using formula (3), wo obtain 

(A [/,] + (/»-!) A [/,]) = (&-«) A [fi\. 

Consequently, for the inequality A (/“l^ ej to hold 
true, it is sufficient to require that 

A [/(]^ e,/ (b ~a). 


( 7 ) 
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Example 1. Using the compounded trapezoid formula, calculate 

5 d X 

^ with an accuracy of O.mI. 

\-\~x 

0 

A Lot 0.1)04, eg-- 0.001, 63 = 0 . 005 . We lind that 

max ( — - — I -2. Employing inequality (G), we find the number 

[0, 1] 1 '1 + ^/ I 

of divisions we need; 


' V 12-0. 004 


We assume that m — 7. Inequality (7) yields a value A l/J - 
0.001 for the permissible error of the values of the integrand. 
We compile a table of the necessary values of the function being 
integrated with three valid digits: 


X 

0 

1/7 

2/7 

3/7 

4/7 



1 


1 

0.875 

0.778 





0.500 


Erom formula (5) wo obtain 
1—0 / lH-d.5 


= 

7 V 2 


-0.875 1 0.778-1-0.700-1-0.036 

+0.583H-0.538J =0.694. 

Rounding off the result obtained, we finally have 
1 

dx 


\ -^-- 0 . 00 ^ 0 . 01 . 
J 1 + -C 


Compare the solution we have obtained with that of Example 6 
Prom 8.4 and Example 3 from 8.5. ^ 


Simpson's compounded formula. In tliis case we divide 
the integration interval into an even number 2m of equal 
subintervals with boundary points a = jtq* • • -i 
^ 2 m ~ ^ so 1^1^^ lengtli of each siibinterval is 

h ^ (/; — a)/ (2m). We represent the integral as the sum 

h Xf X4 ^2m 

j / (j;) dx j f (x)dx+ f {x)dx + . . . + j / (x) dx. 

We apply Simpson’s formula with a remainder [see 
relations (11) and (12) from 8.5] to each term on the 


27-0104 
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right-hand side of this relation. Collecting terms, we 
obtain 

h 

J / (x) dx = (/o f + 4ct, + 2<s^) 

a 


Oi — /i + /s'i' 


(b — a)* Y 
288<»m» 

1=1 




(«) 


• *1“ <^2 = /2 + /l + • . . + /2 m -2 • 


Assuming that the fourth derivative of the function being 
integrated is continuous on the whole interval [a, &], 
we have, by virtue of Wcierstrass’ theorem a relation 




t=l 


/iV(Tj,)--=m/iv (tj), 


b). 


Substituting the expression obtained for the sum of the 
derivatives' into relation (8), we arrive at Simpson's com- 
pounded formula 

b 

/= J f{x)dx^ -^^(/o + / 2 m + 4a,4-2(T2) = /3*, (9) 

a 

"=/l + /3+ • • • +/2m-H <J2“/2“r/l+ • • • +/2m-2 
with a remainder 

^» [/]= -- ne(«. b). (10) 


Consequently, we can represent the estimate of the er- 
ror of the quadrature formula (9) as 

(fi) 

where Ml = max (x) | . This estimate cannot be im- 
[ 0 , 6 ] 

proved since it is attained, say, on the function / = x*. 

By analogy with the trapezoid formula, we shall get 
specific formula for the number of divisions m and the per- 
missible error for each value /, which ensures the required 
accuracy of e when formula (9) is used with error (11). 
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Let e = ei + Eg -|- Eg. Taking relation (11) into 
account, we require, for the inequality e^, that 


2880 / 11 ^ 


A/4 ^ Ej. 


From this we find the condition for the number of divi- 
sions 2m for which the error of the method does not ex- 
ceed Ej: 

2m>(6-.)j/2^Z. (,2) 

We shall find out now what the error of the values of the 
integrand should be for the total error of calculating 
from formula (9) not to exceed Eg. Let the required error 
be A [/il. Then, using formula (9), we have 

[Al/r]<-^(2A(/J + 4mAl/,] 

i 2{m — 1 ) A[/,]).-=(6 — a ) A [/,]. 

Consequently, for the inequality A I/J*] ^ Eg to hold 
true, it is sufficient to require that 

A [/J< eg/ (6 - a). (13) 

As could be expected, we have got the same result as for 
tlie trapezoid formula. This is because both formulas (3) 
and (9) are of the same kind (3) from 8.3, all the coeffi- 
cients Ai being positive and their sum equal to unity. 

B Example 2 . Using Simpson's compounded formula, calculate 
1 

r dx 

the integral \ -j— ; — with an accuracy of 0 . 001 . 

I 

A Let 61 = 0.00045, 62 = 0.00005, e 3 == 0 .JMh) 5 . We find that 
M^= max j j = 24 . With the aid of inequalities ( 12 ) 

we find the number of divisions we must make: 

(],)045 ••• 

Since 2 m is an even number, we assume that 2 m = 6 . Inequality ( 13 ) 
for the permissible error of the values of the iiit?.grand yields a val- 


27 * 
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ue A [/J — 0.00005. We compile a table of necessary values of 
the integrand with four valid digits: 


X 

0 

l/C 

2/6 

3/6 j 

4/6 


1 


1 

0.8571 

0.75 

0.6667 

0.6 

0.5455 

0.5 


From formula (9) we find that 

73 = ^^* [l + 0.5 + 4-(0.8571-|-ll.6(567H 0.5455) 

lo 

+ 2 . (0.75 -1- O.G)] 0.69317 . . . 

Rounding off the result, we finally have 

1 

\ =0.693 ±0.001. A 

J i + x • 

0 

Let us analyse the result obtained in Example 2. Comparing the 
approximate value /j! - 0.69317 . . . with the (*xact value ol the 
integral / -■ 0.69314 . . ., we note that the real difference of the 
exact and the approximate value (about 0.00003) is approximate- 
ly 17 times smaller than the preassigned permissible error (e^ |- 
e .2 - 0.0005). A natural question arises: why is the difference' of tlu' 
theoretically predicted and the practically obtained error so 
great? 

Before answering this question, we ])oint out that such a differ- 
ence between the true error and the estimate required can be 
observed not very frequently and can be predicted in cases similar 
to that considered in Example 2. And what is more, it can be 
reduced to a, minimum by taking into account some auxiliary 
considerations and constructing more cleverly tlie compulation 
process. 

Indeed, in Example 2, by virtue of inequality (12), the error of 
the method 0.0004 is associated with the number of divisions 2 a7i> 
4.1 .... We could not choose the limiting value 4.1 .. . since 
2m must be integral and even and the least permissible value 2m - 
6 we have chosen is naturally associated with a smaller error of 
the method, approximately equal to 0.0001. This is the first cause 
for a decrease in the practical error. 

Next, although all the estimates of the error were the least and 
could not be improved, they were attained on polynomials whose 
derivative appearing as a factor in the expression for the remainder 
was a constant quantity. Now if this derivative varies considerably 
on the interval of integration (and this is quite natural when the 
interval is large), then the corresponding estimate proves to be far 
from optimal, as a rule. If this is the case, it is expedient to deter- 
mine the number of divisions proceeding from the form of the 
remainder given in relations (2) and (8). For Simpson’s formula, 
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for instance, we would get the following inequality for 2m\ 


18 » (2my 


m 



i— 1 




(14) 


whore Ml^ 


max I (.r) |. Evidently, for groat variations 


^‘2/1 

of the fourth derivative on the integration interval, inequality (14) 


V 


M, 


m 

(l/m) 2 A/i 

i- 1 


times as advantageous as inequality (12) 


as concerns the number oT divisions. In principle, wc see under tlie 
sign of tile root the ratio between the maximum absolute value of 
the fourth derivative throughout the integration interval and its 

mean value calculated for m intervals i 1, - 

'rhus the use (»f inectuality (14) in Example 2 for the number of 
divisions .\iel(ls a value 2m 4 and for 2m - (> the estimate of the 

error of the iindhod comes down to 0. 000045. and this is only one 
and a half tin»o ' "rger than the true error. This is a good result. 


FJxerciscs 


1. Calculati* the delinito inlegr 


ral j 


2dx using the for- 


mula for left rectangles for /i 0. 

2. Using the formula for right rectangles for n— 8, calculate 

' (It 


J M 


(• du 

8. Using the trapezoid lorinula lor n 8, calculate ^ fTjTJ • 

0 

5 

4. Using the trapezoid formula, calculate \ — ^ : setting 

. I .r-'-4 


// 5. 

5. From Simpson’s formula calculate 
1 


r d.r 


0 


sotting 2m 1“. 


J COS 2 

dx using Simpson’s formula. Set 2fn— 10. 
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J diT 

- q - g using the Gaussian quadrature 

-1 

formula for 2m — 6, 

8. The function is tabulated as follows: 

X I 0.525 I 0.526 j 0.527 | 0.528 

/ I 0.50121 I 0.50208 | 0,50294 | 0.50381 

Using the method of numerical differentiation, find the first deriv- 
ati\r at the point x* — 0.525. 

9. Find the first derivative at the point x* = 50 for a function 
given as the following table: 

a: I 50 I 55 | 60 | 65 

/ I 1.6990 1 1.7404 | 1.7782 | 1.8129 

1 

Ifl. Calculate the integral ^ f(x)dx with an accuracy o( e: 

0 

(a) / (x) — X* cos X, e — 0.001 , (b) f (x) = x® sin x, e = 0.001, 
(c) / (x) = xe*. e = 0.0001, (d) / (x) = X l/'xe*, e = 0.0001, 

(e) / (i) = e*‘, e = 0.0001, (f)/ (x) = e = 0.0001, (g)/ (x) = 

x» + 1, e = 0.0001, (h) / (x) = sin x, e = 0.001, (i) f (x) = e*, 
e = 0.001. 

11. Calculate the values of the derivative of the function / (a;) 
at the point x — x^ using the four-digit tables of trigonometric func- 
tions with a^tepsize of 1°. Find the absolute value of the result. 

(a) / (a:) == sin x, 3"/ = 41°, (b) / (x) = cos x, x^ == 27.5°, (c)/ (x) = 
tan X, Xi == 50°, (d) / (x) — sin x, _ x^ — 17°30', (e) / (x) = 




Chapter 9 

Approximate Solutions of 
Ordinary Differential Equations 


9.1. Differential Equations 


An equation in which the unknown function is under 
the sign of the derivative or differential is a differential 
equation, for example 


d y/ 
(l.r 


= 2(.y-3), ^ = 


d^z 

dx^ 


xd// — //®d.T. 


dH 


0 , 


]f the unknown function entering into a differential 
equation depends only on one independent variable, the 
differential equation is ordinary. The differential equa- 
tions 

a:2.-^=2, 2s At ^ t is 


are of this kind. 

Now if the unknown function entering into a differen- 
tial equation is a function of two or more independent 
variables, then it is a partial differential equation. For 
instance, the equation 


dH 



= 0 


is a ])artial differential equation. 

The order of a differential equation is the highest order 
of the derivative (or of the differential) entering into 
the equation. For instance, the equations 


_ 4 dH I dH 


are of I he second order and the equations 

• cos t + sin f rr- 1, (x^ — y^) dr + (x^ + y^) Ay = 0 
are of the first order. 
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In this chapter we study only ordinary differential 
equations. 

In the most general case an ordinary differential equa- 
tion of order n contains an independent variable, an un- 
known function and its derivatives or differentials up 
to order n inclusive and has the form 

F (a y, y\ y\ . • -= 0. (l) 

In this equation x is an independent variable, y is an un- 
known function, //', y", . . are derivatives of 

this function. . 

If the left-hand side of the differential equation (1) 
is a polynomial with respect to the derivative of tlie 
unknown function, then the degree of this polynomial is 
the degree of the differential equation. 

For instance, the equation 

{yy I {yy - if I - 0 

is a second-order equation of tlie fourth degree and the 
equation 

(y')- 1 x^y^ — y® -| - 0 

is a (irst-order equation of (he second degree. 

An A?th-order differential equation resolved for (he high- 
est derivative can be written as 

ym -= f (x, y, y', y" , . . (2) 

The solutlQn (or integral) of equation (2) is any differ- 
entiable function y “ : cp (x) which satisfies tin’s equal ion, 
i.e. such that being substituted into equation (2), it turns 
the equation into an identity. 

The graph of the solulion of an ordinary differential 
equation is known as the integral curre of this equal ion. 

The solution of a differential equation which contains 
as many independent arbitrary constants (parameters) 
as its order is a general solution (or general integral) of 
this equation. 

In terms of geometry, the general solution of a differ- 
ential equation is a family of integral curves of that 
equation. 

A particular solution of a differential equation is any 
solution which can be selected from the general solution by 
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giving a definite set of values to the arbitrary constants. 

Tlie arbitrary constants entering into the general so- 
lution are found from the so-called initial conditions. 

A problem with initial conditions is posed as follows: 
find tlie solution .y = (p of the equation ^<^9 — 
f y\ y\ • • which satisfies the auxiliary 

conditions that tlie solution iy = cp (j:) must assume, 
together with ils derivatives up to the order n — 1, 
tlie preassigned numerical values //„, /y', 
for the given numerical value./* — of the independent 
variable .i: 

y yo> y' .'/n. //" .Vo. 

(Conditions (3) are Ihe initial conditions or oalues, llie 
numbers a:^^, y^, //', the initial data 

of tlie sol 111 ion, and Ihe problem of linding the solution 
// " <P W ll^<‘ dilfereiitial equation (2), satisfying the 
initial conditions (.')), is an initial-ralue problem (or 
Cauchy's n: ( 

In the case of a first-order equation, i.e. when u - 1, 
we get Cauchy’s problem for the equation if -= / (./•, y) 
with the initial condition x -- .r,,, y — y^. 

In terms of geometry, (Cauchy’s problem (for a first- 
order equation) consists in isolating, from the whole 
set of integral curves which constitutes the general so- 
lution, Ihe integral curve which passes through the point 
;1/(, with coordinates x -- y - jy„. 

Example. The g(*noral solution of the differential equation 

-r^ 2.r, with the initial condition j/q — 2 for 1, has the lorm 

d.r 

U ^ a- I C. It is a family (d’ parabolas. If we substitute the initial 
data into the general solution, we get 2 1 -|- T, i.e. C = 1. 

Consequently, the particular solution which satisfies the indicated 
initial condition is y .r- | 1. In terms of geometry, this means 

that from the whole set of parabolas which constitute the general 
solution of the differential equation we choose the parabola which 
passes through the point (1, 2) (Fig. 9.1). 

Cauchy’s jiroblcju has a unique solution which satis- 
fies the condition y (.r„) -= jy,, if the function / (j*, y) is 
conlinuons in a certain domain l-i[a,b] ~ { I < 

|</^} and satisfies, in Ihis domain, the 
Lipschilz condition 

h) I - l/(•^ y) I j' -y 1, 
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where N is the Lipschitz constant dependent on a and b 
(a and b are the boundaries of the domain). 

The methods of the exact integration of a differential 
equation suit only a small part of the equations which 
are encountered in practice. 

Therefore of considerable significance are approximate 
methods of solving differential equations which can be 



divided into two groups according to the form of the 
representation of the solution: 

(1) analytic methods which give an approximate so- 
lution of a differential equation in the form of an ana- 
lytic expression, 

(2) numerical methods which give an approximate so- 
lution in the form of a table. 

For the first group of methods, we discuss in this cliap- 
ter the method of successive approximations (Picard’s meth- 
od) and the method of integration of differential equa- 
tions by means of power series, and for the vsecond group, 
Euler’s method and its modifications, the methods of 
Riirige-Kutta and Adams. 

9.2. The Method of Successive Approximations 
(Picard’s Method) 

This method was first used in the process of proving the 
theorem of the existence and uniqueness of the solution 
of differential equations. It is known as Picard’s method. 
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Consider an equation 

y' =1 (x, y) (1) 

whose right-hand side is continuous in the rectangle 
{|a :— \y — and has a continuous 
partial derivative with respect to y. We have to find a 
solution of equation (1) which satisfies the initial con- 
dition 

X = Xq, y (xq) = y^. (2) 

Integrating both sides of the equation from Xq to x, we 
obtain 

y X 

5 ^ f(x, y) da:, 


X 

y(x)-^yo+'\ fix, y)dx. (3) 

*0 

Equation (1) is replaced by the integral equation (3) in 
which the unknown function y is under the integral sign. 
The integral equation (3) satisfies the differential equa- 
tion (1) and the initial condition (2). Indeed, 

X 

y (xq) = yo 5 / (^> y) da; = yo- 

Xo 

Replacing the function y in relation (3) by its value 
we get the first approximation 

X 

ytix) - .Vo+ \ fix, yo)dx. 

*0 

Then we replace y in relation (3) by the value yi already 
found and get the second approximation 


y2ix) = yo + ^ fix, Vi) d*. 
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Continuing the process, we find in succession 

X 

y3(^) = '/o+ j) /(^. J/a) 

Xo 


3C 

J/n W = \ /(^. yn-i) 

Thus we form a sequence of functions 

(/i (JC), y.2 (x), y.j (x), . . y„ (x). 

Tlie following theorem, which we give without proof, 
is valid. 

Theorem. Assume that the function j (.r, y) is continuous 
and has a bounded partial deiiralire jy (.r, y) in the neiff/i- 
bourhood of the point (./’o, y^f), Then, in a certain interval, 
which contains the point Xq, the sequence [pi (j)} converges 
to the function y (x) which is a solution of the differential 
equation y =^- f (x, y) and satisfies the condition y {xq) 

J/o* ^ 

The estimate of tlic error of Picard’s metliod can bo 
found from the formula 

■ \y-yA<.N'‘Mff^_, ( 4 ) 

where M — max | / {x, y) | for x, y g N is 

the Lipschitz constant for Ihe domaiji equal lo 

N = max I fy {x, y) |. The quantity h for determining 
the domain — h^x^Xf^ \-h\ can be calculated 
from the formula 

h = min (a, b^M), f)) 

where a and b are the boundaries of the domain R. 

Example. Use Picard’s method to solve the differential equation 
y' = ^ satisfying the initial conditon = 0, y (jto) — 

yo = 0. 

A We pass to the integral equation 

X 

J/ = !/o+ j 
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or, with due account for the initial conditions, to 



X 

y-= 

f {x‘^-\ y^)dx. 


J 

0 

We get the successive approximations 

X 

X 

!h = ] 1" i/o) <1^ = 

j (x®+i»)(i.i= , 

0 

0 

X 

X 

1 / 2 = j (x^ + y\)dx = 


0 

0 

X 

X 

'/3= j (x'^^yDdxr^ 

f / 2;2 1 1 1 \ 

J V ^ + 180 + 3060/ 

0 

0 


a-3 x’’ 2iii J.15 


3 ' 1)3 ' 2079 ' 59 535- 


We use formula (4) to estimate the error of the third approximation: 

Since the function //' " .r^ |' y- is defined and continuous on the 
entire plane, we can take any nuiubers as a and h. Kor definiteness 
vve choose a rectangle 

/f {I l<0.5, |//-//ol< 1}, 

i.e. /? {-- 3:^ O.f), -- 1}. 

Then 

M -- max I / (j-, y) I max (j- j- y-) =- 1.25, 

N -- max I fy (j-, y) I -- max | 2y | 2. 

Since a ~ 0.5, h/M — 0.8, we have, in accordance with for- 
mula (5), 

h ^ min (a, b/ M) ^ 0.5. 

The solution y will be defined for — 0.5^ 0.5. For « = 3 

we find that 

\ y — y^\^ 1.25- 23.0.5V4! = 5/192. 

We have got a very rough estimate of the error, in actual fact the 
error is considerably smaller. 
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9.3. Integrating Differential Equations by 
Means of Power Series 

The method of successive differentiation. Consider an 
nth-order differential equation 

= / (X, ( 1 ) 

with the initial conditions 

x = Xo, y (Xo) = yo. v' (a^o) = • • • . (^^o) = 1/V*~ 

( 2 ) 

The right-hand side of this equation is an analytic func- 
tion at the initial point Af© (xo, i/o. ^o* • • •» 

We represent the solution y = y (x) of equation (1) in 
the neighbourhood of the point x, as a Taylor series 

^"^0 + 1/0 ®o) “I" ■fj' 

. (3) 

where | a: — Xq \ <i h and is a sufliciently small quan- 
tity. To find the coefficients of series (3), we differentiate 

equation (1) with respect to x as many times as neces- 
sary, using conditions (2). 

In practical calculations, the quantity \x is 

taken so small that for the required degree of accuracy 
the remainder of the series can be neglected. 

If Xq = 0, we get a Taylor series in the powers of x: 

•> (n) 

y “ j/o + T* • • • + (4) 

Example 1. Find a solution of the differential equation y ~ 
y — 4a: -f- 3 which would satisfy the initial condition Xq = 0, 
yo ~ 3. 

A Substituting Vq = 3 into expansion (4), wc obtain 

Successively differentiating this equation, we have 
y' = y' -i 4 = p - 4a - 1, /' = j,' = 1 , - 4a - 1, 

■= and so on. 
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Using the initial condition, we find that 

*/u = l/o “ ''^^0 + 3 == 3 + 3 = 6, i/" = i/o — ^^0 — 1 = 3-1 = 2, 

yo" = 2, = 2, .... !,<,"> = 2. 

Substituting yj, yj, yj" into the right-hand side of relation (*), 
we obtain 

l/ = 3+Gx+x*-l--|-| ^+--- • 


The function 

y = 2e* + 4a; + 1 

is the exact soultion of the given equation. 

If we set h = 0.1, we can compile a table of values of the solu- 
tion of the given differential equation. ^ 

Table 9,1 


*1 

0 

0.1 

0.2 

■ 

The values obtained from 
the analytic solution 

3 

3.6021 

4.2428 

4.8996 

An approximate solution 
by means of a power series 

3 

3.6103 

4.2427 

4.8999 


Example 2. Find a solution of the differential equation y'" — 
x^y = 0 which would satisfy the initial condition x© = 
l/o = 0- 

A As in Example 1, we shall seek the solution of this equation 
as a series (4) in tne powers of x. Since y© = yS = series (4) 
has the form 

y = l + + + h... . (*) 

We rewrite the given differential equation as y" = x^y. Succes- 
sively differentiating this relation, we have 

y'" = 2a:y + x*y', 

y^^ = 2y -f 2a;y ' -f 2xy* + x'^y" = 2y + 4j;y ' + x^y"^ 
y^ = 2y' + 4y' + Axy"-\- 2xy''~[~ x^y”' = 6y' -f- fixy*-}- a:2y"', 

yVI = i2/ + 8xy"' + a:V^» 

y^^ ^ = 20y"' + lOary^^ x*y^ , 

Substituting successively the initial conditions a;® = 0, yo = If 
y» = 0 into each of the relations obtained, we get i/ (0) = 0, 
y**^ (0)=0, y^^ (0)= 2, y^ = y^^ = y^*^ = 0, y^^^^ = 30*2=60. 
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Substituting finally y'\ y^^ . . . into the right-hand side ol 

relation (♦), we get the required solution 

The method of expanding a solution in a series can 
also be used to solve systems of ordinary differential 
equations. 

Example 3. Find a solution of the system 

dx , • j. 

-r— = a: cos t—y sin t, 
dt 

■^ = a:sin t-f-y cos ty 

which would satisfy the initial conditions a: (0) = 1, y (0) = 0. 
A We set 

.r.= a:(()) + a;'(0)< + x''(0)-^ | 




3! 




Differentiating the equations of the system, we obtain 
x" = x' cos t — X sin t — y' sin t — y cos ty 

y" = x' t X cos t + y' cos ^ — y sin ^ and so on . 

Substituting in succession the initial conditions into each of the re- 
lations obtained, we find thatj;' (0) — cos t — 1, y' (0) = 0, 

a:" (0) = 1, y;.(0) = 1, a:"' (0) -= 0, y" (0) - 3 and so on. 

The required solution has the form 

/2 /2 iW 

i + ^+-y-l- • • •» • A 


The method of undetermined coefficients. Consider a 
differential equation 

y' =1 (^. y) ( 5 ) 

with the initial condition y (xj) = y^. The method of 
undetermined coefficients consists in seeking a solu- 
tion of equation (5) in the form of a series with unknown 
coefficients 

— ^o) + «2 — ^(>y^ 

-t- Us (x —Xaf + . . M 


( 6 ) 
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which we can lind by substituting series (6) into equation 
(5), equating the coefficients in the like powers of x and 
using the initial condition. Then we substitute the values 
of the coefficients ao, ai, aj, aa, . . . into series (6). 

Example 4. Using the method of undetermined coefhcients, 
find a solution of the differential equation y' = which 

would satisfy the initial condition Xq = 0^ y (otq) = 1. 

A Since Xq = 0, series (6) assumes the form 

y = Xq + aix + + a^x^ + + . . . . (*) 

Substituting x — Xq and y (xq) = 1 into relation (*), we get Qq = 1). 

For what follows, it is convenient to expand the right-hand side 
of the equation y' x^ + y^ in the powers of {y — 1): 

y' = x^ + [(y — 1) -H Ip ^ X® + 1 + 2 (y — 1) + (y— 1)^. (♦*) 
Differentiating scries (*), wo have 

y' = p 2a2X + 3fl3x‘^ -p Aa^x'^ + . . . . (**♦) 

We substitute now the expression for y' from relation (***), the 
expression for y from relation (*) and == 1 into relation (**). 
Thoh we obtain 

Ui h 2a2u. + + Aa^x^ P . . . = 1 + p 2 (a^x + ^2 

-P agx^ + a^x^ +...) + + a^x^ + ^3^^ + • • 

We remove brackets on the right-hand side of the last relation, col- 
lect terms and equate the coefficients in the like powers of x. As 
a result we have 


ai— 1, 2a2 — 2ai, 3^3 = 1 p2fl2+ai, 4^4 = 2a3 + 2aifl2» 

whence we have = 1, ag = 1, as = 4/3, 

Substituting the values of the coefficients wo have found into 
series (*), we finally obtain 

j/=l + j:-[-i:24-Ax3+-^j:4+ ... .4 


Example 5. Find a solution of the differential equation y*' — 
x-y = 0 which would satisfy the initial conditions Xq = 0, y (xq) = 
^ y' (^o) = 0- 

A Since x^ = 0, wo shall seek the solution in the form of a se- 
ries 

y = ao + a^x + ajx* + . . . + a^x” + . . , . (*) 

Differentiating twice relation (♦), we have 


y' = tti + 2a2X -p 2 a^x’^ + Aa^x^ + . . . + naj^x^~^, (♦*) 

y" = 2fla + fiajx -p 12 a 4 X^ + . . • + a^n (a — 1) x’'“^. (♦♦♦) 

Using the initial conditions, we find, from relations {*) and 
that ao = 1 and = 0. Substituting the values of the coefficients 
we have found into series (*), we get 

y = 1 -P ajx^ + fljx^ + fl 4 X* + . . . + a^x'^. (♦♦♦*) 


28-0104 
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To find the other coefficients of series we substitute the 

expression for y" from relation (*•*) and that for y from rela- 
tion (< 0 ***) into the given differential equation: 

2 a 2 + Bago: + + 20 a 5 X^ + SOaeo:^ + . . .+/i (n— 

— a;* (1 -J- “1“ "h • • • + 

Grouping terms with the same powers, we have 

2ag + BagX + (12a4 — 1) a;® ■+• ( 20 fl 5 ) 

+ (30ae — da) + (42a7 — flg) a:® + . . . =0. 

The relation obtained is an identity. Since we seek a solution for 
a: 0 , it remains to set all coefficients in the powers of x equal 

to j.ero, i. e. 

fla = 0 , <13 = 0 , 12 fl 4 -- 1 == 0 , whence = 1 / 12 , 

fla = 30fla ~ <*2 = Of whence = 0 , and so on. 

The solution sought has the form 

»-‘ + W*‘ + 6fe‘'+-' ■ A 

9* 4. Numerical Integration of Differential Equations. 
Euler^s Method 

To solve ra differential equation of type y' = / {x, y) 
by a numetical method is to find, for a given sequence 
of argumengs Xq, Xi, . . x^ and the number yoi without 
determining the function y == F (a:), the values i/j, 1 / 2 , . / 
y^ such that = F (X|) (t == 1, 2, . . ., n) and 
P M = Uo- 

Thus numerical methods make it possible, rather than 
finding the function y ^ F (x), to get a table of values 
of that function for a given sequence of the values of the 
arguments. The quantity h = — a:*.! is the step of 

integration. 

Let us consider some of the numerical methods. 

Euler's method. This method is rather rough and is 
usually used for approximate calculations. However, 
the ideas that are at the base of Euler's method serve 
as starting points for other methods. 

Consider a first-order differential equation 

y' =f (*, y) (1) 

with theihinitial condition 

X = Xo, y (xo) = yo- 


( 2 ) 
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We have to find a solution of equation (1) on the interval 
la, fc]. 

We divide the interval [a, b] into n equal parts and 
get a sequence Xq, Xg, ...» x^, where Xi = Xq -\- 
ih{i = 0, 1, 2, n) and h = (b -—a)ln is the 

step of integration. 

We choose the /ctli subinterval [t,,, x^^^^ and integrate 
equation (1): 

*/t+i */i+i 

Ij ^ y'i\x-^-y{x) 

*ft *fc *ft 

= y (a^h+i) —y{Xh) = yh+i—yh> 

i.e. 


yh+i=yh+ 5 /(•». y) (•^) 

*h 

If in the last integral we assume the integrand function 
to be constant on the interval [xf^, and equal to 

the initial value at the point x = Xj^, then we obtain 


-Ac -Ic 

yk){^h^i'-^h)^yhh. 

Then formula (3) assumes the form 

yh+i = yh + ykh. (3') 

Designating yt,+i —yk^ ^yk. i-e. y'kh = we get 

1/A+i ^ yk + ^yk- (4) 

Continuing this process and assuming every time the 
integrand function to be constant on the corresponding 
subinterval and equal to its value at the initial point 
of the subinterval, we get a table of solutions of the 
differential equation on the given interval [a, 6]. 

In terms of geometry, Euler’s method consists in the 
following. On the interval [xq, x^ the integral curve is 
replaced by a segment of a tangent to it passing through 


28 * 
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the point Mq (xq, y^). As can be seen from Fig. 9.2, the 
slope of this tangent is 

tan tto = (i^i — y^)l(xy — Xo) = / (Xo, J/o) = y' (^o). 

Then a new segment of the tangent is drawn from the 
point y^ to the integral curve which passes 

through this point. The slope of this tangent is 

tan tti = (j/j - !/i)/(x 2 — X,) = / (xj, y^). 

Continuing the construction ol such segments, we get 
Eulet 's broken line. This line passes through the given 
point Mq (j"o, iJq) and approximates the required inte- 
gral curve. 

If in a certain rectangle 

i?{|x— XoKa, \y—yo\^b} 
the function / (a:, y) satisfies the condition 

I / (-Cl, yi) — / {^1, y^) K -/v I Ui —y^ I 

{N = coast) (5) 

and, in addition, 

^ ^(•/^|<M(M-.con,t). (0) 

then we have the following estimate of the error*: 

( 7 ) 

where y (Xj^) is the value of the exact solution of equa- 
tion (1) for X = x,^ and y^^^ is an approximate value ob- 
tained at the /ith step. 

Formula (7) is mainly used in theoretical calculations. 
In practice use is usually made of “duplication check”. 
First the calculation is carried out with the stepsize h 
and then the step is divided and the calculation is re- 
peated with the stepsize hl2. The error of the more exact 
value yn is estimated by the formula 

\yl —y (i'n) I ^ I l/X — i/n I- (8) 

Example 1. Use Euler’s method to integrate, on the inter- 
val [0, 1.5], the differential equation y' = y — x which satisfies 
the initial condition Xq = 0, ^he step h — 0.25. Carry 

out the calculations with four decimal digits. 
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A To make the calculations more convenient, we compile 
a table. 


Table 9.2 


i 


Vi 

y^ = Vi-x^ 

> 

II 

> 

(1) 

(2) 

(3) 

(4) 

(5) 

0 

0 

1.5000 

1.5000 

0.3750 

1 

0.25 

1.8750 

1.6250 

0.4062 

2 

0.50 

2.2812 

1.7812 

0.4453 

3 

0.75 

2.7265 

1.9765 

0.4941 

4 

1.00 

3.2206 

2.2206 

0.5552 

5 

1.25 

3.7758 

2.5258 

0.6314 

6 

1.50 

.4.4702 




1st step. Using the initial data, we fill in the first row in col- 
umns (2) and 

2nd step. From the equation y[ = yi — xi we find yj {i = 0, 
1, . . ., 5) in column (4). 



3rd step. We multiply the contents of column (4) by h (we cal- 
culate Ay^ = /iy^^ i — 0, 1, . . 5) and write the result in col- 

umn (5) of the same row. 

4th step. To the contents of column (3) we add the contents of 
column (5) of the same row (we calculate yj^^ = ^ 
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1, . . 5) and write the result in column (3) of the next row. We 

determine = xj + /i and then repeat steps 2, 3, and 4 until 
we cover the whole interval [0, 1.5]. 

Euler’s method can be used to solve systems of differ- 
ential equations and higher-order differential equations. 
However, in the last case the differential equations must 
be reduced to a system of first-order differential equations. 
Consider a system of two first-order equations 

= y, z). /q. 

z'=/aU. J/. z) ^ ^ 

with the initial conditions 

y (j'o) = yo. z (jjo) = 3«. (10) 

The approximate values y (z|) ^ yi and z (x^) ^ Zi can 
be found from the formulas 

yi+i = yi + Ay;, Zi+i = z, + Azi, (11) 

where 


Ay< = hfi (zi, yt, zt) Az, = hf^ (x,-, y,-, Zj) 

(i = 0, 1, 2, . . .). (12) 

Example 2. Using Euler's method, find a numerical solution of 

the system of differential equations ~ ^ with the ini- 

\z = (z + y) X 

tial conditions y (0) = 1.0000, z (0) = 1.0000 on the interval 
[0, 0.6J; the step h == 0.1. Carry out the calculations with one 
extra digit. 

A To carry out he calculations, we use Table 9.3. The sequence 
of actions is clear from the table. ^ 

Table 9.3 


i 


D 



B 

ri = (rj + l/px^ 

AZj = z'ih 

0 

0 

K 

0 

0 

IN 

0 

0 

1 

IK 


0 

0 

1 iiliii! 

0.2000 


2 


A 

0.0040 

0.0004 

: ra 



3 


A 

0.0180 

0.0018 

; A 

Bb#W 


4 

0.4 

SI 

0.0480 

0.0048 


BPM 

0.0850 

5 

0.5 


0.1001 

0.0100 

’ \ W^ 


0.1107 

6 

0.6 

I.OITO 



1.3179 

mm 
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Example 3. Using Euler's method, compile a table of values of 
the solution of the differential equation y'' + + y = 0 on the 

X 

interval [1. 1.5] for the initial conditions y (1) = 0.77, y' (1) = 
— 0.44; the step A = 0.1. 

A By means oi the substitution y' = z, y" = z* we replace the 
given equation by a system of equations 



or the initial conditions y (1) = 0.77, z (1) = — 0.44. We carry 
out the calculations with one extra digit. To make the calculations 
more convenient, we use Table 9.4. ^ 

Table 9.4 


i 


’Ji 

y'i ■- ti 

hy\ 


— 

-Vi 

AZj - t\h 

0 

1.0 

0.77 

-0.44 

-0.044 

-0.44 

-0.33 

-0.033 

1 

1.1 

0.726 

-0.473 

-0.047 

-0.473 

~ 0.296 

-0.030 

2 

i .2 

0.679 

-0.503 

-0.050 

-0.503 

-0.260 

-0.026 

3 

1.3 1 

0.629 

-0.529 

-0.053 

-0.529 

-0.222 

-0.022 

4 

1.4 1 

0.576 

-0.551 

-0.055 

-0.551 

-0.183 

-0.018 

5 

1.5 

0.521 



-0.569 




9.5. Modifications of Euler’s Method 

Improved Euler’s method. Consider a differential equa- 
tion 

y' = / ix, y) (1) 

with tlic initial condition 

y i^o) = yo- ( 2 ) 

We have to find a solution of equation (1) on the interval 
la, 6]. 

We divide the interval [a, 6] into n equal parts by 
the points Xi = Xq ih {i 0, 1, 2, . . n), where 
h = (b — a)/n is the step of integration. The gist of the 
improved Euler’s method is in the following. We first 
find auxiliary values of the required lunctiou at 
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the points — xi + ^ using the formula 

J//+1/2 = + -y y'u (3) 

then find the value of the right-hand side of equation 
(1) at the midpoint = / (arf+i/g, r/i+i/g) and deter- 

mine 

Vi+l = Vi + %i + l/2- (4) 

Remark. We can get the estimate of the error at the 
poi'U Xi by means of the “duplication check”: we repeat 
the calculation with the step hl2 and approximately 
estimate the error of the more exact value //* (for the 
step ft/2) as follows: 

I.V* — i/(a:/)| |y?— i/fl, (ri) 

where y (x) is the exact solution of the differential equa- 
tion. This method of Euler is more accurate as compared 
to the method discussed in 9.4. 

Example 1. Use Euler's improved method to integrate the differ- 
ential equation / = y — x for the initial conditions xq = 0, 
^0 = 1 -5 on the interval [0, 1] assuming h = 0.25. Carry out the 
calculations with four decimal digits. 

A We write the results of calculations in Table 9.5 which is 
compiled as follows. 

Table 9,5 


•f* 

h" 


sT 

K 

<|<N 

<I(N 

IN 1 

+ 

+ H 

H II 

a* 

3 * + 

Cl 

all » 

IN 

+ 

< 

( 1 ) 

( 2 ) 

( 3 ) 

( 4 ) 

( 5 ) 

( 6 ) 

( 7 ) 

( 8 ) 

(9) 

0 

0 

1.5000 

1.5000 

0.1875 

0.125 

1.6875 

1.5625 

0.3906 

1 

0.25 

1.8906 

1.6406 

0.2051 

0.3750 

2.0957 

1.7207 

0.4302 

2 

0.50 

2.3208 

1.8208 

0.2276 

0.6750 

2.5484 

1.8734 

0.4684 

3 

0.75 

2.7892 

2.0392 

0.2549 

0.8750 

3.0441 

2.1691 

0.5423 

4 

1.00 

3.3315 

2.3315 

0.2914 

1.1250 

3.6229 

2.4974 

0.6243 

5 

6 

If 

3.9558 

4.6856 

2.7058 

0.3382 

1.3750 

4.2940 

2.9190 

0.7298 
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1st step. Using the initial data, we fill in the fist row in col- 
umns (2) and (3). 

2nd step. From the equation //t = / (xf, iji) = yi — xi we find yi 
for column (4) (i = 0, 1, . . 5). 

3rd step. Wo multiply the contents of column (4) by h/2 and thus 
determine (h/2) yi and then write the result in column (5). 

4th step. We get the contents of column (6) by summing up the 
value of Xi from column (2) and h/2. 

5th step. We sum up the contents of column (3) with that of 
column (5) and write the result in column (7). 

6th step. We substitute the values y/+i /2 obtained 

[columns (6) and (7)1 into the right-hand side of the given differen- 
tial equation, determine write the result in column (8). 

7th step. Wo multiply the contents of column (8) by the step of 
integration h and determine hy\j^^i 2 [column (9)]. 

8th step. We add the contents of column (3) to that of column 
(9) and write the result — yi + %<+ 1/2 (i = 0, 1, . . ., 5) 
in column (3) of the next row. 

Then we repeat the whole calculation process beginning with 
the second step. 

The improved Euler-Caiichy method. The gist of this 
method is the following. We first find an auxiliary quan- 
tity 

Ui + I = yi + hy'i, (6) 

then calculate?//^, — / and find the required 

solution using the formula 

tl,., = yi + h-a+^ . (7) 

The estimate of the error can bo found from formula 
(5) after a repeated calculation with llie stepsize h/2. 

Example 2. Using the improved Euler-Cauchy method, integrate 
the differential equation from Example 1. 

A The results of calculations are given in Table 9.6. The table 
is filled in as follows. 

tst step. Using, the initial data, we fill in the first row in col- 
umns (2) and (3). 

2nd step. We determine the value of yj = / yi) = yi — Xi 
(i = 0, 1, . . ., 5) for column (4). 

3rd step. We multiply the value of yi from column (4) by the 
step of integration h and write the result in column (5). 

4th step. We find arj+i ~ xi~\- h(i = 0,1,. . ., 5) for column (6). 

5th step. We sum up the contents of column (3) with that 
of column (5) and write the result in column (7), i.e. find 

/s/ 

»i*i = yt + Wi- 
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Table 9.6 


i 


aT 

.M 

K 

II 

^ ... 

V ... 

aa 

iH 

+ 

iT 

< 

+ 

sT 

II 

+ 

+ 

h"* 

1 

vi 

1 ^ 

II 

+ 

+ 

v + 

+ 

V 

* 

•wi 

d 

(1) (2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

(9) 

(10) 

0 

0 

■1 


0.3750 

0.25 

1.8750 

1.625 


0.3906 

1 

0.25 

1.89-ifi 

1.6406 

0.4102 

0.50 

mm 

\rmm 

0.4502 

0.4302 

2 

0.50 

2.3208 

■P:W»K 


0.75 

2.7760 

2.0260 

0.5065 

0.4808 

3 

0.75 

2.8016 


ISH 

fmSi 

3.3145 

2.3145 

0.5786 

0.5458 

4 

1.00 

3.3474 

2.3474 

0.5868 

1.25 

3.9342 

2.6842 

0.6710 

0.6289 

5 

6 

1.25 

1.50 


2.7263 


1.50 

4.6579 

3.1579 


0.7355 


6th step. Wc substitute the values of and yi^i we have 
found into the right-hand side of the given differential equation 

f 

and find for column (8). 

7th step. We multiply the result of column (8) by the step of 

f 

integration hand find hyi+i [column (9)]. 

8th step. We find Ayi column (10) for which purpose we find the 
half-sum of the quantities written in columns (5) and (9). 

9th step. We sum up the contents of column (3) with that of 
column (10) and write the result in column (3) of the next row, i.e. 
determine yi+y = y^ + 

Then we repeat the whole calculation process beginning with 
the second step. 

The improved Euler-Gauchy method with successive 
iterative computations. This method is more accurate 
than the Euler-Cauchy method discussed earlier. The 
gist of this method is that every value of yi obtained is 
subjected to iterative computations. We first find a 
rough approximation 

y\+i==yt + M{Xi, yd ( 8 ) 

and then construct an iterative process 

ii¥i = yi + yi)+fi^i+i> 


( 9 ) 
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We continue the iterative calculations until two suc- 
cessive approximations coincide in the cal- 

culation digits in question. Then we assume that ^ 
after three or four iterations, the digits do 
not coincide for the chosen value of A, we reduce the cal- 
culation step h. 

A Examples. Using the method of iterative computation, hnd, 
with the accuracy to within four coincident decimal digits, a solu- 
tion of the equation y' = y — x fov the initial conditions y (0) = 
1. Obtain the solution of the interval [0, 1.5] take h = 0.25. 

A From formula (8) wc find that 

yo + h {y, - x^) - 1.5000 0.375 = 1.8750. 

Next, using the iterative process (9), we find, in succession, 

y\" = yo-\ yKj/o— 

= 1 .50nf) + 0. 125 (1 .50001 * -f 1 .875 - 0.25) = 1 .89062, 

!/',** = !/c 4 ((!/o - *o) + -*i)] 

o 

= 1.5^0+0.125 (1.5000+ 1.89062-0.25) = 1.89258, 

yr’ = yo+-j [K— ««) 1- (ffi*’— «i)] 

= 1.5000+0.125 (1.50')0+ 1.89258-0.25) = 1.89282, 

!/*/’ = !/o -I- Y [(j/o— ®o) + (!/i”— ^^i)] 

= 1.50(K) + 0.125 (1.5000 + 1 .89282 — 0.25)= 1.89285. 

Jn the last two approximations four digits coincide. Therefore, 
after rounding off, we can assume yi ^ 1.8929. 

Again using formula (8), for i = 1, we find that 

= Vi + hf (x„ y,) = yj + /t (y, — a:,) 

= 1.8929 + 0.25 (1.8929 - 0.25) = 2.3036. 

From formula (9) wo find the successive approximations: 
y‘^> = 1.8929 + 0.125 [1.6429 + (2.3036 — 0.50)1 = 2.3237, 
y<i> = 1.8929 + 0.125 [1.6429 + (2.3237 — 0.50)1 = 2.32622, 
y^«> = 1.8929 + 0.129 [1.6429 + (2.32622 - 0.50)1 = 2.32654, 
y^« = 1.8929 + 0.125 [1.6429 + (2.32654 — 0.50)1 = 2.32658. 

We can terminate the iterative calculations and assume y, ^ 
2.3266. Using then formulas (8) and (9), we get a solution of the 
given equation. The results of the calculations are given in 
Table 9.7. ^ 
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Table 9.7 


i 


Vl 

„(0) 

*'1+1 

«<*> 

*'t+i 

,,< 2 ) 

*'i+l 

,,( 3 ) 

"i+l 


*'<+1 

0 



1.875 


1 .89258 

1 .89282 

1 .89285 

1.8929 

1 

0.25 

1 .8929 

2.3036 

2.3237 

2.32622 

2.32654 

2.32658 

2.3266 

2 

0.50 

2.3266 

2.78325 

2.80908 

2.81231 

2.81271 

2.81276 

2.8128 

3 

0.75 

2.8128 

3.3285 

3.36171 

3.36586 

3.3664 

3.36645 

3.3664 

4 

1.00 

3.3664 

3.9580 

4.0007 

ran 

4.0067 

4.00679 

4.0068 

5 

6 

1 

1.25 

1.50 

4.0068 

4.7587 

4.6960 

4.7509 

4.75776 

4.75870 

4.75872 

4.7587 


9.6. The Runge-Kiitta Method 

The Runge-Kutta metliod is one of the most accurate 
methods. It has much in common with Euler’s method. 

Assume that on the interval [a, b] we liave to find a 
numerical solution of the equation 

y' = f (x, y) ( 1 ) 

with the initial condition 

y (-^o) “= Vo- (2) 

We divide the interval [a, b] into jl equal parts by 
the points Xi = Xq -\- ih {i ~ 0, 1, . . ., n), where 
h {b —a)ln is the step of integration. As in Euler’s 
method, in the Runge-Kutta method the successive 
values yi of the required function y can be found from 
the formula 

yi+i = yi + Ay.-. (3) 

If we expand the function y in a Taylor’s series and 
restrict the calculations to h* inclusive, then we can re- 
present the increment of the function Ay in the form 

&y = I/{x+h)—i/(x) = h!/'{x)-i- (x) 

(■*) 

where the derivatives y" (a:), y"' (x), y^'^ {x) can be found 
from equation (1) by a successive differentiation. 
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Instead of direct calculations with the use of formula 
(4), in the Runge-Kutta method we find four numbers: 

/Ci = fe/ {x, y), 

k^^hf , y + -^), 

k3 = hf {^x -\r~ , y + x) ’ 

k^^hf {xArh, y^-k^). 

We can prove that if we assign the weights 1/6, 1/3 
1/3, 1/6 to the numbers k^, k,^ respectively, then 

with an accuracy to within the fourth powers, tlic weighted 
mean of these numbers, i.e. 

4“ 4" IT (6) 

is equal to tlie value of Ay calculated from fornniJa (4) 

H’2A-2-h2/i:3 + /^4)* (7) 

Thus, for every pair of values of Xi and y,* from columns 
2 and 3 we find the values of 

-hfiXi, y,), 

+ 4 , yr\-^), ( 8 ) 

-I 4 * +-¥■)• 

k^K-^hf{xt + h, yi + k^i), 

from formulas (5) and, using formula (7), we determine 
Aj/i - 4 -1- 2 /c<3‘> + 

and then 

J/i+i = J/i + Ayj. 

The numbers ki, k^, Ag, kj^ have a simple geometric 
meaning. Let the curve MqCMi (Fig. 9.3) be a solution 
of the differential equation (1) with the initial condi- 
tion (2). The point C of this curve lies on a straight line 
which is parallel to the y-axis and bfcects the interval 
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[xj, Xi+i] and B and G are the points of intersection of 
the tangent drawn to the curve at the point Mq and the 
ordinates AC and N^Mi. Then, with an accuracy to 
within the factor h (where h = — xi)^ the number 

is the slope of the tangent at the point Mq to the in- 
tegral curve MqCMi, i.e. ki = hy[ = hj {xi, yi). 

The point B has coordinates y^ yt-]- 

and, consequently, with an accuracy to within the 



Fig. 9.3 

factor h, the number /fg is the slope of the tangent drawn 
to the integfal curve at the point B {BF is a segment of 
this tangent). 

Through the point Mq we draw a straight line parallel 
to the segment BF, Then the point D has coordinates 

X z= Xi !/ = + y ^3 with an accuracy to 

within the factor h which is the slope of the tangent 
drawn to the integral curve at the point D (DR^ is a 
segment of this tangent). Finally, through the point 
Mq we draw a straight line, parallel to which cuts 
the extension of N^Mi at the point {xt + h, yt + k^). 
Then, with an accuracy to within the factor /i, k^ is the 
slope of the tangent drawn to the integral curve at the 
point 

It is convenient to use the scheme shown in Table 9.8 
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to make calculations by the Runge-Kutta method. This 
table is filled in as follows. 

1st step. In columns (2) and (3) of the running row 

Table 9.8 



we Avrite the values of x and y wc need, (If it is tlie first 
row, then we write the initial data, Xq and y^.) 
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2nd step. We substitute the values of x and y of tlie 
running row into the right-hand side of the differential 
equation (1), hnd / (a;, y) and write the result in column (4) 
of the same row. 

3rd step. We multiply the value of / (x, y) of column 
(4) we have obtained by the step of integration calcu- 
late k = hf {x^ y) and write the result in column (5) of 
the same row. 

4th step. We multiply the values of k obtained by the 
appropriate coefficient (by 1 if the value is k^ or k^ or by 
2 if is /cg or k^) and write the result in column (6) of 
the running row. 

We repeat steps 1, 2, 3 and 4 to find every k in the ith 
solution. 

We sum up the results of the sixth column, divide by 
6 and find = -g- S and yi+i = i/j + Ay,. 

Then we repeat all the calculations beginning witli the 
first step until we cover the wliole interval [a, 6]. 

The Runge-Kutta method has the order of accuracy 
throughotit the interval [a, 6]. It is very difficult 
to estimate the accuracy of this method. We can get a 
rough estimate of the error by means of the “duplication 
check” from the formula 

• (9) 


where y (x,) is the value of the exact solution of equation 
(1) at the point xi and y* and y, are approximate values 
obtained with the steps hl2 and h. 

If B is the preassigned accuracy of the solution, then 
the number n (the number of partitions) for determining 
the step of integration h = {b — a)/n is chosen such that 

h* < e. (10) 

However, wo can change the step of calculations when 
we pass from one point to another. 

We can estimate the correctness of the choice of the 
step h using the relation 


g= 




( 11 ) 


where q itfust be equal to several hundredths, otherwise we 
must reduce the stepsize h. 
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Example 1. Given a diHorential equation y' = y -- x satis- 
fying the initial condition y (0) = 1.5, find, with an accuracy of 0.01 
a solution of this equation for a: = 1.5. Use the Runge-Kutta meth- 
od and make calculations with two extra digits. 

A We choose the initial step of calculations h from the condi- 
tion < 0.01. Then h <0.3. To make the calculations more con- 
venient, we assume that h = 0.25. We divide the whole integration 
interval [0, 1.5] into six equal parts by the points Xq = 0, xi =0.25, 
jTa == 0.50, ^3 = 0.75, x^^ = 1.00, x^ = 1.25, = 1.50. From tho 

initial conditions we have Xq = 0, = 1 .5. We seek the first approx- 

imation yi + Ayo, where 

A!/«=4 (fci»> + 2A4''> + 2*J«> + /£<<»). 

Using formulas (8), we obtain 

*<«) = (j,„ _ arj) = 1 .5000 .0.25 = 0.3750, 

= 1(1.5000 + 0.1875) — 0.125]. 0.25 = 0.3900. 

|)]a 

= 1(1.5000 + 0.1953) — 0.125]. 0.25 = 0.3920. 

n®’ -l(.Vo + A-^®'--(*o h*)lA 

= [(1 .5000 + 0.3926) - 0.25] -0.25 = 0.411 tO. 

Con.scquently, 

Av„ = i (0.3750 + 2 .0.3900 + 2.0.3920 + 0.4100) = 0.3920, 

!/, = 1 .5000 + 0.3920 = 1 .8920. 

One can see from Table 9.9 how to go on with the solution of the 
equation. Thus the final result is y (1.5) - 4.74. A 

The Riinge-Kutta inothod can bo employed in the 
solution of systems of differential equations. 

Consider a system of lirst-order (lifforcnlial equations 

y ” / .y» 2 ), H2i 

z^^g{x,y,z) ^ ^ 

with the initial conditions 

X = IJ (x„) = .t/„, z (.r„) = z„. (13) 

In this case we determine the numbers and Az*: 

Ay, - 4- ^ ^ 

Az, = 4- (fV> + 24’' + 24' + 4 '. ^ 


29-0104 
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Table 9.9 


i 

X 

V 



^v 

( 1 ) 

( 2 ) 

( 3 ) 

( 4 ) 

( 5 ) 

( 6 ) 

0 

0 

0.125 

0.125 

0.25 

1 . 5<>00 

1 .6875 
1.6953 
1.8926 

1 .5000 
1.5625 

1 .5703 

1 .6426 

0.3750 

0.3906 

0.3926 

0.4106 

H 






0.3920 

1 

0.25 

0.375 

0.375 

0.50 

1.8920 

2.0973 

2.1073 

2.3251 

1.6420 

1.7223 

1.7323 

1.8251 

n 

0.4105 

0.8612 

0.8662 

0.4562 






0.4323 

2 

■ 

2.2343 

2.5523 

2.5652 

2.8093 

1 .8243 

1 .9273 
1.9402 
2.0593 

0.4561 

0.4818 

0.4850 

0.5148 

0.4561 
0.963 > 
0.9700 
0.5148 






0.4841 

3 

0.75 

0.875 

0.875 

1.00 

2.8084 

3.0657 

3.0823 

3.3602 

2.0584 

2.1907 

2.2073 

2.3602 

B 







0.5506 

4 

m 

3.3590 

3.6539 

3.6751 

3.9965 

2.3590 

2.5289 

2.5501 

2.7465 

0.5898 

0.6322 

0.6375 

0.6686 

0.5898 

1.2641 

1.2750 

0.6866 


— 




0.6360 
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Table 9.9 (continued) 


i 

X 

V 

y' = /(*. V) 

fc =- M (X. y) 

Ay 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

5 

1.25 

3.9950 

2.7450 

m 

0.6862 


1.375 

4.3381 

2.9631 


1.4816 


1.375 

4.3654 

2.9904 


1.4952 


1.50 

4.7426 

3.2426 

HI 

0.8106 , 






0.7456 

6 

1.50 

4.7406 





where 

= hf (Xi, y,, zi), 


__ T 

’’t! Uit 2 

i). 






= hf (xi + 

h 

2 » 

yi + 

kp 

2 ’ 

Zj + 

2 )' 

iP: 

-hff ^^x, H- 

h 

2 ’ 

yi + 

kP 

2 ’ 

Zf + 

iP \ 
2 )' 


■ kf ( 3 :, • + 

h 

2 » 

yt + 

kP 

2 ’ 

Zf-h 


iP - 

-^hg (xi -1- 

h 

2 » 

yi + 

kP 

2 ’ 

Zi + 

IP \ 

2 /’ 

kP^ 

= hf (x, + h, 

Ui 

^kP, 

zj -h, 

ip). 


/r = 

= hg {xi + h, 

yi 

^-kP, 

zH- 

IP). 



Then we gel a solution of the system 
«/Hi = yt + = 2, + Az,. 

Example 2. Given a system of differential equations 

2 // — X 

z 

2.V 

z + x 

with the initial conditions Xq — 0.5, — 1, — find a solution 

of the system for x — 0.6. Make calculations with five decimal 
digits. 



20 * 
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A We choose a step /t = 0.1 and find the numbers /rj, I 21 

^3* ^4» ^4* 

2-0.5 

— =- = U.'l : 

Zo 


k, = u. 2yo- =‘o 


= 0.15000, 


l^ = h — ?5^ = 0.1 — = 0.13333, 
1-5 


h = h 


k^ — k 


Zo+“^ 


1 — 0 0 14100 

1.06067 ‘ • 


l("«+t)+(^«+t) 




Zo+- 




L=rh 


' 1 .06650 
2 


M^"+~r) 1 

(*o+-|-)+(*«+4)J 


2-1.0705(1 
,06650 + 0.55 


'•-‘[5 


2 (yp+^s) 1 


=0.1 


2.1.14918 
1.13245 + 0.6' 


= 0.13266, 


(Zo + W + (Zo + W J 

Consequently, 

A»o=-5'(®-^5+2'^-14^<^‘’+2.0.14918+ 0.14998) = 0.14672, 
A*o=-|-(0.13333 + 2-0.13299 +2.0,13245 +0.13266) = 0.13281 

and we get the value of the required functions at the point x =0.6; 
= I + 0.14672 = 1.14672, r, = I + 0.13281 = 1.13281. A 


9.7. Adams’ Extrapolation Method 

When,, using the Runge-Kutta method to solve a dif- 
ferential equation, it is necessary to carry out numerous 
calculations to find every yi. In the case when the right- 
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hand side of an equation includes a complicated analytic 
expression, the solution of the equation by means of the 
Runge-Kutta method is very laborious. Therefore, in 
practical computations, Adams^ method is usually used 
which does not require repeated calculations of the 
right-hand side of the equation. 

Consider a differential equation 

y' = f (3:, y) (1) 


with the initial condition 

X = Xo, y (Xo) = J/o- (2) 


We have to find a solution of this equation on the interval 
[a, fe]. 

We divide the interval [a, 6] into ji equal parts by 
the points .r,* = x^i + ik (i = 0, 1, 2, . . ., n). We choose 
a siibinterval [x*j, .r/+i] and integrate the differential 
equation (1). Then we get 


or 


*i+l 

yi+i = yi+ ^ .v'dof, 


( 3 ) 





//' da;. 


To hnd the derivative, we use Newton’s second inter- 
polation formula (restricting our computations to third- 
order differences): 

y' = yi + t^yi-i + 
where t = (x — Xi)lhj or 

+ (4') 


Substituting the expression for /y' from formula (4') into 
relation (3) and taking into account ♦hat da; = h df, 
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we have 
1 

^Vi = ^ 5 (y'i + f^y'i - 1 + l^Yi-2 

^f+ ^2t A3y;_3)df 

^hy’i+^^ (%i_i) + 4- + T ihy'i-3). 

( 5 ) 

In what follows, we designate 

It = y\h = / (a;j, (i = 0, 1, 2, . . n). 

Then, for any difference, we have tsT'qi ^ {y'ih) and 

Ayj = 9 j + 4- ^9i-i + (®) 

From the formula -f- Ay^ we get a solution of 

the equation. Formula (6) is known as Adams' extrapola- 
tion formula. 

To begin the computation process, we need four initial 
values yo» l/n ^21 Us constituting the so-called initial 
interval which can be found from the initial condition (2) 
with the use of one of the familiar methods. The initial 
interval of the solution is usually obtained by means 
of the Runjge-Kutta method. 

Knowing y^, yi, yg, yg, we can determine 

% = hy'o = hf (xo, yoY, = hy[ = hf (xj, i/i), 

92 = hy't = hf (xj, y^Y = hf (xg, ^3). (7) 

Then we compile a table of diRerences involving the quan- 
tity q (Table 9.10). 

Adams’ method consists in extending the diagonal 
table of differences with the use of formula (6). By means 
of the numbers qg, Aqg, A®qi, A®qo> which cross the table 
along the diagonal, we find from formula (6), setting 
n = 3 in it (the last known value of y is y..,), that 

Apa = 98 + 4” ^92 + A%. 
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Table 9.10 


1 


yi 

Ai/j 

J/i-- /(»£. I/j) 

q^hv\ 


A*9i 

A«9i 

(1) 

(2) 1 

(3) 

' (4) 

(5) 



(8) 

(9) 

0 

IQ 

yo 

1 

/ (®o. yo) 


Ay. 

A*yo 

A^f/o 

1 


i/i 


/ (^1, yi) 

ni 

Agi 

A*gi 


2 

X2 

92 


y») 

7 . i 

Ays 



3 

.Tg 

!/3 

Ays 

/(®3. Va) 

73 




4 


Va 







5 

^5 








C 

^0 









We tabulate the value of Ayg and find = j/g + Aj/g. 
Then, using and the value of wo have found, we 
determine / (^•4, ^4), ^4, A^g, A^^g, A^gj, i.e. we get a 
new diagonal. From these data we obtain 

^!j\^g3+ ^^2 + 1 -^®'/!. y5=^yk+^yk- 

We iJujs continue with tlie table of solution calculat- 
ing the right-hand side of the differential oquatio i (1) 
once at each stage. 

We can also use Runge’s principle to make a rougli 
estimate of the error. It consists in the following: 

(1) we find a solution of the differential equation for 
the step h, 

(2) next we double the value of the step h and find the 
solution for the step // = 2A, 

(3) and then we calculate the error of the method from 
the formula 


li/n — .V2nl 
— 1 » 


(«) 


e = 
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where i/^ is the value of the approximate calculation 

for the double step H = 2h and value of the 

approximate calculation for the step h. 

Remark. When calculating with the step we assume 
that wo have an error proportional to at every step 
and with the step 2h we have an error proportional to 
if the order of accuracy of the method is defined 
and equal to fe"'. 

Note that in Adams’ extrapolation formula (6) the third 
finite differences A‘^q are assumed to be constant. There- 
fore v^e can find the value h of the initial step of calcu- 
lations from the inequality < e, where e is the preas- 
signed accuracy of the solution. 

In practical calculations we usually watch the course of 
the third finite differences choosing h such that the ad- 
joining differences A^qt and should differ from 

each other by not more than one or two unities of the 
specified decimal place (not counting the extra digits). 

Example 1. Use Adams’ method to calculate, with an accuracy 
of 0.01, the value of the solution of the differential equation y' = 
y — X for the initial Xq = 0 and yo = 1*5 when x = 1.5. Carry 
out all calculations with two extra digits. 

A As before, we choose h from the relation < 0.01, i.e. h -- 
0.25. We take the initial interval y^, y^y y^ from the solution of 
Example 1 in 9.6. To solve this equation, we compile two tables, 
the main Table 9.11 and the auxiliary Table 9.12. Their purpose 
is clear from the tables themselves. 

The final result is y (1.5) = 4.74. 

Table 9,1] 


i 

fl 

yi 

A7/f 

Vi 

= /(5C., 
Vi) 



D 

AVv^ 

(1) 

( 2 ) 

( 3 ) 

( 4 ) 



( 7 ) 

( 8 ) 

( 9 ) 

0 

0 




0.3750 

0.0355 

0.0101 

0.0028 

1 

0.25 




0.4105 

0.0456 

0.0129 


2 

0.50 

2.3243 


1.8243 

0.4561 

ill 



3 

0.75 




0.5146 

3 



4 

1.00 

3.3588 

0.6356 

2.3588 

0.5897 

11 iSiiSi 



5 

1.25 

3.9944 


2.7444 

0.6861 




6 

1.50 

1^.7394 
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Table 9,12 


1 

■ 





3 

0.5146 

0.0293 


0.0011 

0.5504 

4 

0.5897 

0.0376 

0.0069 


0.6356 

5 


0.0482 

0.0089 

0.0018 

0.7450 


Adams’ metliod can also be used to solve systems of 
differential equations and wlh-order differential equa- 
tions. 

Assume that we have a system of two equations 


z — //» 2). 


Then Adams’ extrapolation formulas for this system have 
1 he form 


A//i -- Pi + ^Pi H- A3/;,_3, 

Az/ = 8i + Y T 


( 10 ) 


where 

Pi = hi/i - /i/i (Xi, tji, z,), 

81 ~ ("^ji Uit Z() 

and 

.'/i-tl = i/i + Al/i, Zmi = Z; 4- AZi. 


Example 2. Using Adams’ method, find a numerical solution 
of the system of differential equations 

fy' = (z — y) X, 

\z' ={z + y)x 

for the initial conditions y (0) = 1.000, z (0) = 1.000 on the inter- 
val [0, 0.0], the step is h 0.1. 

A We take the initial interval of solution from Table 9.3 (earlier 
we used Euler’s method to solve this system). We shall seek the 
values of the functions y (x) and z (x) forx 4 = 0.4,X5 — 0. 5 and 
Xu 0.6 using formulas (10) and designating fi (x, y, z) — y' ~ 
(z — y) X and (x, z/, z) — z' ~ (z + y) x. The calculations are 
given in Tables 9.13, 9.14, and 9.15 (Tables 9.14 and 9.15 are aux- 
iliary). 
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Table 9J3 


i 

*< 



Pi 

AP| 

A»P| 

A»p^ 

0 

0 

1.0000 


0.0000 

0.0000 

0.0004 

0.0006 

1 

mmm 

1.0000 


0.0000 

0.0004 

0.0010 

0.0010 

2 

RKI 

1.0000 


0.0004 

0.0014 

0.0020 

0 . 0 fJ 04 

3 

mtm 

1.0004 

0.0032 


0.0034 

0.0024 


4 

0.4 

1.0036 

0.0081 


0.0058 



5 

0.5 

1.0117 

0.0150 

0.0110 




6 

0.6 







c 

*1 

*1 

AZ| 



A-^l 

A»5, 

0 

0 

1 .0000 


0.0000 

0.0200 

0.0004 


1 

mm 




0.0204 

0.0010 

0.0013 

2 

nlS 

1.0200 



0.0214 

0.0023 

0.0007 

3 

mM 

1.0604 

0.0732 

KlufilKl 


0.0030 


4 

0.4 

1.1336 

0.0984 

0.0855 

0.0267 



5 

0.5 

1.2323 

0.1271 

0.1122 




6 

0.6 

1.3594 







Table 9J4 


i 

B 

"I 

D 



B 


0 

m 

1 .0000 

1.0000 

0.0000 

0.0000 


0.0000 

1 

BVI 

1 .0000 


0.0000 

0.0000 

0.2000 

0.0200 

2 


1.0000 

1.0200 

0.0040 

0.0004 

0.4040 

0.0404 

3 





0.0018 

0.6182 

0.0618 

4 

0.4 

1.00361 

1.1336 


0.0052 

0.8549 

0.0855 

5 

0.5 


1 .2323 

0.1103 1 

0.0110 

0.1220 

0.1122 


Table 915 


i 

Pi 


- n - A ’ pi-i 


Ay| 

3 

0.0018 


0.000425 

0.000225 

0.0032 

4 

0.0052 


0.000850 

0.000375 

0.0081 

5 

O.OliO 


0.0010 

0 . 0 ( K 115 

0.0150 
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Table 9.15 (continued) 


i 


■Q 


mi 

A*, 

3 

0.0618 

0.0107 

0.000425 

0.000225 


4 

0.0855 

0.0118 

0.000958 

0.000488 


5 

0.1122 

0.0134 

0.00125 

0.00026 

■ 


Table 9.14 serves for deteriiiining the right-hand sides of this 
system and for finding pi and g,-, and Table 9.15, for determining 
diyi and Az^ from the difierences of the values of p and g obtained 
in Table 9.13. 

9.8. Milne's Method 

As the Uunge-Kutta method, Milne’s method is of high accu- 
racy. 

Assume i.hai wo have to find, on the interval [a, 6], a numerical 
solution of the differential equation 

y' = 1 (*. y) (1) 


with the initial condition 

y (^o) = yo- ( 2 ) 

We divide the interval [a, b] into n equal parts by the points x,- = 
Xq + ih (i = 0, 1, . . ., rt), where h = {b — a)/n is the step of 
integration. 

Using the initial data, we employ some technique to find succes- 
sive values Jji = y (xj), 1/2 = 2 / (^ 2 )* — V (^ 3 ) required 

function y (x). Thus we find yj (i = 0, 1, 2, 3). 

Wo can find the approximation yi and y^ for the successive 
values yj (i = 4, 5, . . ., n) from Milne's formulas'. 

y i = y i-4 + -^ ( 2 /» - 3 — - 2 + 2 /i - 1 ), ( 3 ) 

— h — f r f 

'/i^'/<-2+-^(!/«4-%J-i + !/i-2), (4) 


where = / (arj, yi). _ 

Wo can show that tho absolute error of the value yi is approxi- 
mately equal to 

®i = 4r -^li- 


es) 
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Therefore, if Cj- ^ e, where e is the preassigned limiting error of the 
solution, them we can set iji ^ yi and y\ = f (x^, yi). This occurs 

when yj and yi coincide at the decimal places of interest to us. If 
condition (5) is fulfilled, wc pass to the calculation of the next value 
yui^ repeating the process. Otherwise, beginning with a certain 
place, we reduce the stepsize h and recalculate the corresponding 
initial interval. As in the Runge-Kutta method, the value of the 
initial step can be found from the inequality c. e. 

To derive Milne’s formulas (3) and (4), we use the Newton’s 
first interpolation formula for the derivative y' at a chosen point xji 
and restrict our calculations to the third-order differences. This 
is equivalent to the approximation of the integral y — y{x) of the 
dilTerenMal equation (1) by a four-degree polynomial. We have 




g(g-i) 

2! 




<?(q— i)(g— 2) 
31 


A34. 


Removing the brackets, we have 
!/' y'h + q^y'h -j — n) + 4 " ~ 


(ti) 


( 7 ) 


where — (a: — x/J Ik, 

Setting A;— i — 4 in relation (7), we obtain 

4 + (8) 


We integrate relation (8) with respect to x from to 
[yi-4 -| </A/i-4+ A3|/i_4 

“i'l* *i-4 

I 9® “ -|- 2q . > 1 . 

- 1 1 ^^yi - 4 J d j;. 

Taking into account that q = (x — xi-^lh and da: = Mq, wo have 
yi — Vi-i^h^yi-i d(/ + A(/'i-4 7d?-l-AVi-4 dry 


-[-A3y'i-4 


q^ — 3q^-\-2q 
0 


d?} 


= fc'*|^4j/f-4+8Aiyi-4 + -^ A3y,^4 + -|-A3j/J_4 j . (9) 
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- 4 ]ti - 3 — Hi - 4 » 

A2yi_4 — — 2//i-3 + ?/i-4, 

A3//i - 4 — !/l t — 3i/i - 2 h 3//'i - 3 — i/i - 4 » 

we can substitute these expressions into relation (9) and get 
Milne’s first formula (3): 

Ah / ' 

in = -H — yi -2 + 2iji-{). 

To derive Milne’s second formula (4), we set /c = i — 2 in rela- 
tion (7): 

y'^yi- 2 -\- q^yi - 2 + — 7) ^^yi - 2 

-[:^(,3__3,2 + 29)A3j,--2. (10) 

where q = {x — xi^^lh and da: = h&q» 

Wo integrate relation (10) with respect to x from to xi\ 

2 

y' ( 1 . 1 - h ( y'i - 2 + q^yi - 2 + — 2 

»(-2 

+ — 37® 1-29) A3yi-2] dq. 

From this we have 


/// — |2i/i-2 + 2A7/i-2 A2z/i-2 j . (11) 

Taking into account that A//i-2 ~ i/i-l ^//i-2 and — 

'Jyi-\-\-yi-2j we get Milne’s second formula (4): 

[/i = + (yi + 4i/i-l + t/i-2). 

Example 1. Given a differential equation y' = y — x satisfying 
the initial condition x^ = 0, y' (ar^) = 1.5, calculate, with an 
accuracy of 0.01, the value of the solution of this equation for x — 
1.5. Carry out calculations by the combined Runge-Kutta and 
Milne’s method with two extra digits. 

A Wo choose the initial step of calculations. From the condi- 
tion < 0.01 we get h = 0.25. Then wo can divide the whole 
integration interval into six equal parts by the points x^ = 0, 
Xi = 0.25, X2 = 0.50, x^ ~ 0.75, x^ = 1.00, = 1.25, x,, — 1.50. 

We take the initial interval y^, y^, yg, y^ from the solution of Exam- 
ple 1 in 9.6. To solve this equation, we compile Table 9.16. 
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Thus we get an answer: y (1.5) = 4.74. 4 
When solving a system of differential equations 

lz' = q)(a:, //, z) 


with the initial conditions y (xn) = y^^ z (x^^) — Zg, Milne’s formulas 
are written separately for the functions y (a;) and z (x). The order of 
calculations remains the same. 

Example 2. Given a system of equations 


I 


!/'=cos(j/+l, lz) + l, 


with the initial conditions y (0) = 3.14159, z (0) = 0. Use Milne’s 
method to calculate, with an accuracy of e = 0.0001, the solution 


Table 9.17 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 



y, = (V|* *|) 

y'i 

i 

*1 

L 




"I 

*1 

Vi 

H 



0 






1 






2 






3 






4 

0.4 

3.16057 

0.49906 

0.15098 

1.44678 

5 

0.5 

3.18104 

0.64870 

0.27079 

1.54596 


( 7 ) 

( 8 ) 

( 9 ) 

( 10 ) 

( 11 ) 

( 12 ) 

^ 1 = 

^1 


*» 


*1 

II 

mm 



3.14159 

0.00000 

0.00000 

1.04824 



3.14184 

0.10981 

0.00732 

1.14801 



3.14364 

0.22960 

0.03224 

1.24773 



3.14903 

0.35934 

0.08001 

1.34734 



3.16062 

0.49905 

0.15701 

1.44678 

1.7-10-* 

0 

3.18166 

0.64869 



7.10-» 

4.l(r» 



































464 


Computational Mathematics 


of this system on the interval [0, 0.5] taking a step /^ = 0.1 and 
assuming the values of the functions y (x) and z {x) to be known for 
Xi = 0.1, X 2 = 0.2, Xg = 0.3. These values are y (0.1) = 3.14184, 
y (0.2) = 3.14364, y (0.3) = 3.14903, z (0.1) = 0.10981, z (0.2) = 
0.22960, z (0.3) = 0.35934. 

A We shall seek the values of the functions y (0.4), y (0.5) and 
2 (0.4), 2 (0.5) from formulas (3)-(5). We carry out the calculations 
with the aid of two tables: the main Table 9.17 and the auxiliary 
Table 9.18. 

We write the initial interval of the solution in columns (7) 
and (8) of Table 9.17 and find the values of y[ and zi [columns (9) 

Table 9.18 



4 

5 


Vl 


Vi 


2Y'i-3 

0.01464 

2.29602 

0.06448 

2 .49546 

-Y'i-2 

--0. 30224 

-1.24773 

-0.08001 

-1.34734 

2yi-i 

0,16002 

2.69468 

0.31402 

2.89356 


. 0.14242 

3.74297 

0.29849 

4.04168 


0.01898 

0.49906 

0.03980 

0.53889 

Yi-, 

3.14159 

0.00000 

0.14184 

0.10981 

^1 

3.16057 

* 

0.49906 

3.18164 

0.64870 

Yi-2 

0.03224 

1.24773 

0.08001 

1 .34734 

iYi-\ 

0.32004 

5.38936 

0.62804 

5.7871 

Yi 

0.15698 

1 .44678 

0.27079 

1 .54596 


0.50926 

8.08387 

0.97884 

8.68042 

ft V(2) 

0.01698 

0.26945 

0.03263 

0.28935 

Yi-t 

3.14364 

0.22960 

3.14903 

0.35934 

#■ 

Yi 

3.16062 

0.49905 

3.18166 

0.64869 
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(10)]. Using then the data obtained and formula (3), we find 
i/4 and Z4 (Table 9.18). 

We transfer the values of and 24 into the main table [columns 
(3) and (4)], determine yi and zi [columns (5) and (6)^f TabkQ.l?] 

and then, using again the auxiliary table, we find and Z4. We 
transfer their values into columns (7) and (8) of Table 9.17. We 
find that 

^ - I r _ 

64.1 =-^(y 4 — */ 4 )» 64.2= — (24—2:4) 

[columns (11) and (12) of Table 9.17]. For the preassigned permissi- 
ble error e — 0.0001 we see that we can omit the recalculation of 

the initial interval and take y^ as y^. To find y (0.5) and z (0.5), we 
repeat the whole process of calculation. 

The final result is y (0.4) - 3.16062, 2 (0.4) - 0.49905, y (0.5) - 
3.18166, z (0.5) = 0.64869. 4 


9.9. The Notion of the Boundary- Value Problem 
for Ordinary Differential Equations 


We use r.'imple of a second-order equation 

F (X, y. y\ yl - 0 (1) 

to discuss the solution of the boundary-value problem for 
ordinary differential equations. 

The simplest two-point boundary-value problem for 
equation (1) is posed as follows: we have to line! the func- 
tion y ^ y (x) which satisfies equation (1) within the 
interval [a, /;] and the boundary conditions 


tpi ly (a), y' («)1 = 0 , 

{ 2 ) 

92 [y W, y' if>)] - 0 

at its endpoints. 

Let us consider some kinds of a Iwo-point boundary- 
value problem for equation (1). 

Assume, for instance, that we are given a second-order 
differential equation 


y" f (•»•, y. y') (3) 

with boundary conditions y (a) ~ A, y {h) = 5 (a < 6), 
i.e. the values of tlie required function y = y (x) at the 
boundary points x ~ a and x ~ b are known. Then, 
in terms of geometry, the solution of equation (3) is an 


30-0104 
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i ilo^ral curvo // — // (./:) wliicli passes lliroiigli the given 
points M (a, A) and N (b, W) (Fig* 9.4). 

Assume now that, for equation (3), we are given the 
values of the derivatives of tlic required function at the 
boundary points, i.e. y' (a) — y' (6) = /?i. Then, 
in lerms of geometry, the solution of equation (3) means 
that we have to find an integral curve y = y (x) of this 
equation which would cut tlie straight lines x == a and 
X = b the angles a == arctan Ai and P ^ arctan 
respectively (Fig. 9.5). 
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Assume, finally, Lliat, for equation (3), wo know the 
value of tlio required function y (a) A at one boundary 
point and the value of the derivative of this function 
y' (b) ^ at the other point. A boundary-value prob- 
lem of this kind is known as the third {mixed) boundary- 
value problem. Tn terms of geometry, the solution of 
equation (3) means that we have to find an integral 
curve y y (x) of this equation which would pass through 
the point M (a. A) and cut the straight line x — h at 
an angle [3 = arctan (Fig. 0.6). 

If the diiferential equation and the boundary condi- 
tions are linear, then the problem is linear. In that case 
the differential equation (1) and the boundary condi- 
lions (2) are written as 

y" 1- P W y’ +q(x)y^f (.), (A) 

I Po'/(^) +P iJ/'(^)"=Y2. 

where p (./:), q (x), f (x) are known functions continuous 
on the inlcrval fa, 6], ao, ai, po, Y 2 given 

constants, and | | + | aj | 0 , | Po I + I Pi I = 7 «^ 

If / (x) = 0 for x^ then the equation is homo- 
geneous otherwise it is inhomogeneous. 

If -- 0 and Y 2 === 0» corresponding boundary 

condition {^homogeneous. If both the differential equation 
and the boundary conditions are homogeneous, then the 
boundary-value problem is homogeneous. 

9.10. The Method of Finite Differences for Second-Order 
Linear Differential Equations 

Assume that we are given a second-order linear differ- 
ential equation 

if I p {x) y' + q [x) y j (x) (1) 

with two-point linear boundary conditions 
^aoy{a)^a,^y' {a)--- A, 

(|ao| + |a,|:^0, IPol + IP.I^O) 

SO* 
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and that p (x), q (x) and / (j::) are continuous on the inter- 
val la, ^1. Furthermore, assume that Xq == a, = b, 
Xi = ih (i — i, 2, n — 1) are systems of 

equispaced nodes with a step h = {b — a)ln and pi —■ 
P {xi), Qi ^ q (Xi), fi = / (Xi). 

We designate the approximate values of the function 
y (x) and its derivatives y' (j:) and y" (x) obtained as a 
result of calculations at the nodes Xi and yi, y'i and y\ 
respectively. In each interior node we approximately 
replace the derivatives y' (j*,-) and y'' (xi) by the Unite- 
difference relations 

_ yui — yi yu2—^yui + yi /o\ 

yi 1 » £/i ];2 » 

and set 




yi — yo 


Un 


.Vn — j/n-l 
h 


( 4 ) 


for the endpoints = a and Xj^ = b. 

Using formulas (3) and (4) we approximately replace 
equation (1) and the boundary conditions (2) by a system 
of equatioTvs 


Ihipi + q,y, /,, 


( 5 ) 


We thus arrive at an algebraic system of ir^ f 1 equations 
in M + 1 unknowns. Solving such a system, we obtain a 
table of approximate values of the required function. 

If we replace y' and y" (x,) by the central- 
difference relations 


y'i 


yi+i — .V/-1 . » .V/'+i — 2t/i + Ui-i 

2h ’ 


(6) 


we can get more accurate formulas. However, we can 
use formulas (5) for the derivatives at the endpoints. 
Then we get a system 

yur-2v^± _ yi-x , ^ = /,- , 

+ ( 7 ) 
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Example. Using the iinite-differcnce method, find the solution 
of the boundary-value problem 

(0.9) -0.5/ (0.9) = 2, 

U(1.2) = l 

with an accuracy of 0.001. 

A We divide the interval [0.9, l.2| into parts with a step 
h ~ 0.1. Then we get four nodal points with abscissas -- 0.9, 
xi — 1.0, == 1.1, 2:3 = 1.2. At the interior points = 1.0 and 

^2 — 1.1 wo replace this equation by the finite-difference equation 




Xi 


yj+i yj-i 

2h 


(i-^1. 


2 ). 


(*) 


Using the boundary conditions, we set up finite-diffference 
equations at the endpoints: 


fyo+0.5 

U-1. 


yi—yg 


(**) 


Collecting terms and taking into account that n = 0.1, we rewrite 
equations (♦) and (**) in the forms 

i/£,i(2 + O.Ui) - 4y,(l - 0.01) + (2 - OAxt) = 0.02(x^+l), 

l-2yo — yi ^-4, fjs = 1 

respectively. 

This problem reduces to the solution of the system of equations 
ri.2yo~yi--'0.4, 

^ 2.1 I/O — 3.90yi + 1 .9^2 = 0.04, 

U .1 lyi — 3.96^2 f 1 .89^3 -= 0.042. 

Solving this system, we obtain yo = 1.406, = 1.287, =1 .149, 

ya = 1.000. 4 


Exercises 

1. Using Picard’s method, find three successive approximation 
of the solution of the following differential equations: 

(a) y' — 4y (1+ar); the initial condition is y (0) = 1, 

(b) y' — X — y; the initial condition is y (0) = 1. 

2. Find the first seven terms of the expansion in a power series 
of the solution y = y (x) of the equation y" + 0.1 (y')® + (1 + 
O.lj;) y = 0 for the initial conditions y (0) = 1, y' (0) — 2. 

3. Find a solution of the differential equation y' = x^ + y^ 
which would satisfy the initial condition 3:3 = 0, y (xq) — 0. Restrict 
the calculations to the terras of the expansion in a power scries 
which involve x’. 

4. Setting h — 0.1, use Euler’s method to solve the following 
differential equations for the given initial conditions on the indi- 
cated intervals: 
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(a) j/' =- y + 3a:, y (0) = -—1, x 6 [0, 0.5], 

(b) y* = X — 2y, y (0) = 0, a; 6 [0, 1]. 

5. Using improved Euler’s method, find, on the interval [0, 1], 

2x 

the table of solution of the differential equation y' — y for 

the initial condition y (0) = i assuming that h — 0.2. 

6. Using the improved Euler-Cauchy method, solve the 
differential equation from Exercise 5. 

7. Taking h = OA find, by the Runge-Kutta method, the solu- 
tions of the following differential equations for the given initial 
conditions on the indicated Intervals: 

(a) y' = X + y (1) = 0, a: 6 U, 2], 

(b) y' = x^ — y, y (0) = 2, a; 6 [0, 1]. 

8. Use Adams’ extrapolation method to solve the differential 

equation y' ~ 2x — y for the initial condition y (0) 1 on th(‘ 

interval [0, 1]. The initial interval of the solution is given: 1, 

= 0.9145, ^2 “ 0.85G2, y^ — 0.8225 (assume that h — 0.1). 



Chapter 10 

Approximate Methods 
of Solution of Partial 
Differential Equations 

10.1. Classification of the Second-Order Differential 
Equations 

Mafiy important practical problems of bydroclynarnics, 
Iieat ami mass transfer, boat comliiction, diffusion, the 
llieory of elasticity and other fields of knowlcdjre arc 
described by linear partial differential equations of the 
second order, anionq which, equatiom in turn independent 
I'ariahles* admit of the most simple and visual physical 
inlerprctation: 

H- 2ai2?ijc2/ + ^^22^hjy "I v 1“ '! ^ 

(i) 

wlieri^ a (r, //) is an unknown fnneiion which must be 
(lelined, a,i, rzj.j, a 22 » ^ specified functions of 

(he independent variables .r and // known as the coefficients 
of (lie equation, and F is tlic ^iven function of x and // 
which is the ri^ht-hand side of the equation. If the coefFi- 
cieiils of equation (1) are constant, then it is a linear equa- 
tion with constant coefficients. Equation (1) is homogeneous 
if F - 0. 

A solution {integral) of equation (1) is any funciion 
which, boinq substituted for"wnn"'the equation, turns the 
e(| nation into an identity. 

The necessary conditions for the existence and unique- 
ness of e([uation (1) essentially depend on the coefficients. 
Ui,, ^ 22 - We shall assume that at least one of the coef- 
ficients is not identically zero (otherwise we would have 
a first-order equation). It turns out that the properties 


* [lore and honcoforth we use the followinir dosijrnations for 

du dhi dhi , 

the dm vail ves: “a-j, - ^ and so on. 
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of the solution of equation (1) depend, to a large extent, 
on the value (the sign, to be more precise) of the dis- 
criminant A = ajg — ^ 11 ^ 22 - 

In connection with the difference in the properties of 
solutions and, consequently, the methods of solution, 
the following classification of equations is accepted. As- 
sume that the discriminant retains sign or is zero every- 
where in a domain D. 

Equation (1) is elliptic if A<C 0, parabolic if A — 0 
and hyperbolic if A >0. 

If the discriminant changes sign when passing from 
one point of the domain D to another, then the equation 
is of a mixed type. 

This classification is due to the fact that elliptic, par- 
abolic and hyperbolic equations describe problems which 
are essentially different in their physical meaning and 
which deal with physical phenomena different in nature. 
Thus equations of heat conduction and diffusion (parabol- 
ic) express the laws of conservation of energy and matter. 
These equations are constructed on the basis of the laws 
of Fourier and Nernst which are similar from the point 
of view of mathematical formulation. 

On the other hand, the equation of oscillation of a 
string (hyperbolic) is the law of conservation of momentum 
and is based on Newton’s second law. 

Finally, an elliptic equation specifies a function which 
is quite different in nature and which defines stationary 
processes which do not vary in time. 

We know from the course in mathematical physics 
that under certain conditions imposed on the coefficients 
^12 ^22 (say, if they are twice continuously differ- 

entiable) there may occur a transformation of the vari- 
ables 

^ = (P (x, i/), T) = \|5 (x, I/), (2) 

which turns equation (1) into one of the following cano- 
nical forms^ 

u\i + Ux\'x\ = / (an elliptic equation), (3) 

uii = / (a parabolic equation), (4) 

= / or uii — u^r\ = / (a hyperbolic equation). (5) 
Here / = / (S, tj, n, wg, Wti) is a function of independent 
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variables, of an unknown function and its first deriva- 
tives. Note that a hyperbolic equation has two equiva- 
lent canonical forms. 

For equation (1) with constant coefficients the transformation of 
the variables (2) is linear and simple in form. Consider these trans- 
formations for each type of the equation. 

For elliptic equations 

((}) 

dll dll 

For parabolic equations 

— r]-x. (7) 

dll 

For hyperbolic equations 

dll ®11 

Note that for parabolic equations q may, in general, be an 
arbitrary function independent of 

Example, the equation u^x + ~ ^ canonical 

form . 

A Here dn — 1, di^ — 0.5, - 0 and, therefore, the discri- 

minant A 0.5^ — 1 - d 0.25 > 0. Consequently, this is a hyper- 
bolic equation. Using the appropriate transformation of variables 
(8), we obtain 

1 1 
Uxx —5- K?; + :2“En + «nTi). “A-7--y 

Thus the canonical form of the original equation is 

“a — «rit| = — 4F (?, tl), 

where 

T' a. n) (- g . 

We have obtained the second canonical form. 

We can show that the transformation of the variables a = ^ + 
q, p — g — q leads to the first canonical form UaR '■= — /" (P — 

a, P). A 

In what follows, we consider the canonical forms (3)- 
(5) of equation (1). 

10.2. Glassification of Boundary- Value Problems 

In this section we discuss the simplest canonical equa- 
tions (3)-(r)) from 10.1. We have mentioned (in Sec. 10.1) 
that different types of equations describe different phys- 
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ical processes. Thus, tlie equal ion* 

Utt — Mjcx / (a 0 , ( 1 ) 

is the equation of oscillation of a string and describes the 
processes connected with tJie mechanical, electrical, 
acoustic and other kinds of oscillation. 

The equal ion 

Ut -= t). (^) 

known as the equation of heat conduction, describes heat 
flow, diffusion and other processes of transfer. 

The equation 

^xx T f y)i ('^) 

known as Poisson's equation describes a stationary ther- 
mal held, a potential flow of fluid and other physical 
phenomena connected witli transition to a steady state. 

To describe a physical process completely (uniquely), 
we must indicate the equation of this process and, in ad- 
dition, specify the initial conditions (the initial state 
of the process) and the conditions for variation of a cer- 
tain function on the boundary of the domain in which the 
process takes place. In terms of mathematics, this is 
connected with the nonuniqueness of the solution of the 
differentia] equation. 'Therefore, to dehne the solution 
uniquely, we must deliiic the equation itself and, in addi- 
tion, to impose additional conditions whicli are classi- 
iied as initial* and boundary conditions. Throe types of 
boundary-value problems are (listin^mished. 

Initial conditions are conditions which dehne, at a 
certain moment, known as the initial moment, the value 
of the required solution (and sometimes its time deriva- 
tives too) for all points of the domains being considered. 

Caucliy\s problem is the first type of boundary-value 
problems (initial-value problem). TJiis is the problem of 
solving equation (1) or (2) for which only initial condi- 
tions (the initial state of the process) are defined as addi- 
tional conditions. 


* Herei^and heucidorth, for belter physical visualricss, the 
variables :i; and y correspond to the space coordinates and t to the 
time coordinate. 
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Cauchy’s problem does not involve boundary condi- 
tions. This problem is formulated for hyperbolic and 
parabolic equations. The absence of boundary conditions 
is due to the fact that we consider oitlier an iinboiindod 
domain or a small initial time interval when tlie elToct 
of the boundary is ne^lig:ibly small. 

A problem without initial conditions^ which involves 
only boundary conditions, is the second type of a boun- 
dary-value problem. In their turn, boundary conditions 
are usually divided into three kinds. 

A boundary condition of the first kind is a condition un- 
der which the required function assumes specilied values 
ou the boundary of the domain being considered. 

A boundary condition of the second kind is a condition 
under which the normal derivative of the required func- 
tion must assume specified values on the boundary of 
the domain being considered. 

A boiuidary condition of the third kind is a condition 
undei* wliich n linear combination of the required func- 
tion and its normal derivative is specified on the 
boundary of tfie domain being considered. 

From the point of view of mathematics, boundary con- 
ditions of the first and second kinds are special cases 
of conditions of the third kind. However, they liavc been 
separated not only for historical reasons but also due to 
their essentially dilTereut physical interpretation and a 
definite diiference in the methods of solving the corre- 
sponding boundary-value problems. 

The initial conditions in applied problems may be 
absent when these problems involve moments of time 
sufficiently distant from the initial time moment, when 
the effect of the initial conditions is weak. Problems of 
this kind are often called steady-state problems. Problems 
of this type can be formulated for all kinds of equations 
(1) (3). 

The third kind of a boundary-value problem is a 
mixed problem iu which both initial and boundary condi- 
tions are specilied. Tliis is a generalization, in a certain 
sense, of problems of tlie first two kinds. Cauchy’s prob- 
lem and a boiiudary-value problem without initial con- 
ditions are two extreme limiting cases of the mixed prob- 
lem. The former is the limiting case for e sufficiently small 
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time interval and the latter, for a sufficiently large time 
interval. The mixed problem is formulated for hyper- 
bolic and parabolic equations. 


10.3. Statement of the Simplest Boundary-Value Problems 

In this section we consider various statements of bound- 
ary-value problems on the assumption that their solu- 
tions are sufficiently smooth. Here and in what follows 
we understand the sufficient smootliness of a function to 
be tlie continuity of the function and of the necessary 
number of its derivatives. In the statement of boundary- 
value problems, the sufficient smoothness usually means 
the continuity of all functions and derivatives appearing 
in the differential equation and the boundary conditions. 

The classical solution of a boundary -value problem 
is any function which satisfies the differential equation at 
every interior point of the domain of definition of this 
equation and is continuous in the domain being con- 
sidered, including the boundary. 

The corresponding statement of a boundary-value 
problem is called classical. Thus a classical statement 
automatically imposes some restrictions on the input 
data of the boundary-value problem. Thus, for instance, 
it is required that the right-hand side of equations (1)- 
(3) be continuous and the boundary functions be suffi- 
ciently smooth. Note that in the most interesting applied 
problems the right-hand sides have essential peculiari- 
ties and therefore it is not sufficient to make a classical 
statement. In such cases we introduce the concept of a 
generalized solution, which we shall not discuss here but 
shall only consider the classical solution. 

Let us pass now to the statement of problems. 

Cauchy^s problem for an unbounded domain. We shall 
formulate this problem for the equation of oscillation of 
a string and the equation of heat conduction. 

We shall consider the process of oscillation of a thin 
infinite (very long) string under the action of a continuous- 
ly distributed external force with density /. We assume 
that the force acts in one plane (Fig. 10.1), the plane of 
oscillation of the string (x, u) and the string is a flexible 
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elastic thread. Let the value of the tension wl]ich appears 
in the string due to its bending obey Hooke’s law and 
the oscillations themselves be sufficiently small. Tlien 
the value of the displacement u {x, t) satisfies the equa- 
tion of oscillation of the string 

Utt —«**=/ (^, t) (t >0, — oo < a: < oo). (1) 

For the process to be unique, we must also specify the 
initial displacement and the initial velocity dislribu- 



lion. In lerms of mathematics, this corresponds to the 
specification of tlie initial conditions: 

u {x, 0) = Uo (x), Uf (x, 0) = Ml (,r). (2) 

We have to lind the classical solution of equation (1) 
which satisfies the initial conditions (2). 

Thus formulated, problem (1), (2) is known as Cau- 
chy's problem for a hyperbolic equation. 

Let us investigate now the process of temperature 
distribution in a thin infinite (very long) bar. We as- 
sume that the heat flow obeys Fourier’s law and the varia- 
tion of the body temperature is proportional to the quan- 
tity of heat imparted to the body. We assume that inside 
the bar the heat, characterized by the density of licat 
sources / can be liberated and absorbed. Then the dislri- 
hution of temperature in the bar is described by llie 
equation of heat conduction 

Uf — Wxx = / 0 —oo < ‘T < oo). (3) 

For a unique definilion of the process, it is necessary 
to indicate the initial distribution of temperature. This 
corresponds to the specification of llie initial condition 

u (x, 0) = Mo (x). (4) 
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We liave to iind the classical solution of equation 
(3) which would satisfy the initial condition (4). 

The problem (3), (4) we have formulated is known as 
Cauchy's problem for parabolic equations. 

When posing bonndary-valne problems and especially 
when finding numerical solutions, it is necessary 1o an- 
swer the following three fundamental questions corre- 
sponding to the natural physical requirements: 

(1) whether a solution of the problem exists and whether 
or not the boundary conditions redefine it, 

(2; if a solution exists, then whether it is unique, 
(3) whether the solution continuously depends on the 
initial data of the boundary-value problem (/, u,,, i/j, 
etc.), i.G. whether it varies continuously with a contin- 
uous variation of the right-hand side of the equation 
and the boundary conditions. This property is called the 
stability of the solution relative to the input data. 

A boundary-value problem is correct if its solution 
exists, is unique and stable. 

The classical Cauchy problem for the equation of oscil- 
lation of a string is correct if the functions /, Uo and n, 
are sufficiently smooth. 

For Cauchy’s problem for the equation of heat conduc- 
tion to be correct, in addition to the smoothness of / 
and Uq, it is also necessary that the solution be limited. 

A stationary problem (a problem without initial data). 
Let us consider a steady-state condition of temperature 
distribution dn a bounded thin plate of an arbitrary 
shape with a smooth boundary. Let the function u (x, y) 
express the temperature at every point of the plate. Un- 
der the ordinary laws of heat distribution described above 
when Cauchy’s problem for the equation of heat conduc- 
tion was formulated, the function u y) salislies 
Poisson’s equation 

^xx “1“ ~ / l/)» (^» y) ^ ^ 1 (‘^) 

where the function / defines the density of heat sources 
of the plate. When there are no sources (/ = 0), equation 
(5) becomes Laplace's equation: 

^xx d"' ^yy ~ 


(fi) 
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For the doscriptioji ol Iho process to he unique, wo 
must doiine the Jieat conditions on the houndary of the 
plate. We can do tliis l)y specifying or distributing the 
lempcraLure on (he houndary, or, else, hy distributing 
I lie lieat flow. 

The conditions of heat haJaJice of the radiating Jiody 
and the medium are also possible. Depending oji heal 
conditions on the boundary, we distinguish three bound- 
ary conditions for the function u (.r, y). Let F he the 
i)ouiidary of tJie domain 1) of delinition of equation ((>). 
Jn terms of mathematics, the boundary co/iditions can 
J)e formulated as follows: 

the boundary coJidition of the first kind: 

u Ir -- (po (x, //), (.r, y) £ T, (7) 

tlic boundary condition of the second kind: 

//). (a-', (8) 

the ho’Uui.MV condition of the lliird kind: 

The derivative is taken with respect to the oiiler nor- 
mal to the curve l\ A, >0 is the ihormal conductivity, 
(P(,, (p, and (p 2 are functions delined on F, (p 2 being the 
product of llie thermal conductivity hy Ihe temperature 
of the medium which is in contact with the body. 

Thus the boundary-value j)rohlom consists in finding 
the classical solution of equation (5) or (h) satisfying one 
of the boundary coiiditions (7)-(9). 

Depending on the kind of the boundary conditions, 
three boundary-value ])roblems are distinguished: the 
first boundary-value problem (5), (7), which is Diri- 
clileVs problem, the second boundary-value problem (5), 
(8) which is Neumann s problem and the third boundary- 
value problem (5), (9). 

For sufficiently smooth input data, the first and the 
third problem for the equations of Poisson and Laplace 
are correct. 

For Neumann’s problem, the uniqueness theorem con- 
sists in the fact that under the same boundary conditions 
two of its solutions may vary by a constant quantity. 
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Jn problems of malhemaiical physics, of considerable 
importance are harmonic functions. 

A function u (x, y) is harmonic in a domain D if it is 
continuous together with its second-order derivatives 
and satisfies equation (6) in this domain. 

Here are some properties of harmonic functions. 

1° (principle of the maximum). If the function u y) 
is defined and continuous in D = U T and satisfies equa- 
tion (fi) in D, then u attains its maximum and minimum 
values on the boundary F, i.e. 

max u{x, y) ^ max u{x, y), 

{X, y)ED (3C, 2/)6r 

min u{x, y)'^ min u(x^ y). 

(*, y)£D (X, jy)6r 

2° (a consequence of property 1°). If the functions u (.r, y) and 

V (a:, y) are continuous in D, harmonic in D and v for (a:, i/) ^ Fi 
then V for (a;, y) ^ D, 

3*^ (a consequence of property 1°). If the functions u and v are con- 
tinuous in Dy harmonic in D and \ u \ ^ v for (x, i/) 6 f then | m j ^ 

V for (a:, y) 6 P- 

The mixed boundary- value problem. Let us consider 
a problem of heat propagation in a thin bar of unit 
length. We place one of its ends at the point :r ~ 0 and 
the other end at the point x ~ I, In the time interval 
0 <C t <Z T the temperature distribution in such a bar 
is described by the equation 

= / (0 < a: < 1, 0<t^T) (10) 

with the initial condition 

u {x, 0) = Uq (x) (0^ 1), (11) 

and for the solution to be unique in this case, it is also 
necessary to specify the temperature conditions at the 
ends of the bar. We can do this with the aid of boundary 
conditions similar to those formulated for the equations 
of Poisson and Laplace. 

The boundary condition of the first kind (the tempera- 
ture is specified at the end of the bar j; = 0) is 

u (0, t) = (po (t) (0 < T). 


(12) 
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The boundary condition of the second kind (the heat 
flow is specified at the end of the bar x = 0) is 

= (pi(^) (0<i< T), (13) 

Tlie boundary condition of the third kind is 
— Wjc (0, t) + ku (0, t) = (p 2 {t) (0 < ^ < T). (14) 

For the other end of the bar x =--- 1, the right-hand sides 
of the boundary conditions (12)-(14) are replaced by 
ypQ (t), \l)i(^) and (0 respectively. Note that the initial 
and the boundary condition must satisfy the so-called 
matching conditions, i.e. Uq (0) = q)o (0) under condition 
(12), Wo* (0) = (pi (0) under condition (13) and —Uqx (0) + 
(0) = (p 2 (0) under condition (14). Similar mat- 
ching conditions must be fulfilled a I the other end of the 
bar :r = 1. 

Thus, for the first boundary-value prol)lem the mat- 
ching conditions mean that 

u„ (0) = (Po (0), «„ (1) = (0). (15) 

In the general case, different conditions may be at 
different ends of the bar so that the total number of all 
possible combinations of boundary conditions is (). 

Here is one of the possible boundary-value problems. 
We have to hnd a solution of equation (10) which would 
satisfy the initial condition (11) and the following boun- 
dary conditions: 

^ (0, t) ^ (po (t), u (1, t) - (t) (0 < f < T). (16) 

Problem (10), (11), (16) is known as the first boundary- 
value problem for the equation of heat conduction. Cor- 
respondingly, the boundary-value problem (10), (11) 

with the boundary conditions (13) or (14) at both ends 
of the bar is the second or the third problem. 

Other boundary-value problems with various combi- 
nations of boundary conditions (12)-(14) at both ends 
of the bar are posed by analogy. 

Boundary- value problems of the first, the second and 
the third kind are correct if the corresponding conditions 
of smoothness and matching are fulfilled for the input 
data. 


31-0104 
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The solutions of the equation of heat conduction possess 
the following significant property, which is similar to 
the property presented for the solution of Laplace’s equa- 
tion. 

The principle of the maximum. If the function u {x^ t) 
is continuous in the domain Dt {0 ^ T, 0^ 1} 

and satisfies equation (10), then for / = 0, the maximum 
and minimum values of the function u {x^ t) are attained 
either at the initial moment or at the point x = 0 or x = i 
of the boundary. 

Let us consider now the oscillation of a thin string of 
unit length. The value of the displacement u {x, t) 
is described by the hyperbolic equation 

Utt—Uxx^f (0 < X < i, t ■>()). (17) 

In this case the initial conditions have the form 

u (x, 0) — - Ufl (x), Uf {x, 0) = Mi(x) (0 ^ X ^ 1), (18) 

We shall Qonsider the boundary conditions in the same 
form as for the equation of heat conduction, i.e. (12)- 
(14). Problem (17)-(18) with the same boundary conditions 
at both ends of form (12)-(14) is the first, the second and 
the third boundary-value problem, respectively, for a 
hyperbolic equation. All these problems are correct if 
the corresponding conditions of smoothness and matching 
are fulfilled for the input data. 

As an exanfple we shall formulate, the first boundary- 
value problem for the equation of oscillation of a string. 

We have to find a function u (x, t) which would satisfy 
equation (17), the initial conditions (18) and the fol- 
lowing boundary conditions: 

U (0, t) = (po (t), U (1, t) - l|5o (t) {t > 0). (19) 

The physical meaning of the boundary conditions of 
the first kind is that both ends of the string oscillate in 
present 'modes according to the laws of the given functions 
(Po and^i|)o. The boundary condition of the second kind 
corresponds to the fact that a law of the action of a force 
is defined ft the endpoint. The boundary condition of the 
third kind corresponds to the elastic fastening of the end 
of the string. 
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10.4. The Method of Finite Differences. The Principal 
Concepts 

For the simplest boundary-value problems formulated 
in 10.3, certain exact solutions are given in various courses 
in mathematical physics. But the majority of even 
linear equations which describe practical processes are 
such that they do not admit of constructing an exact 
solution by means of elementary functions. In such cases 
wo resort to approximate methods. We usually consider 
two kinds of approximate solutions, analytical and numer- 
ical. We shall consider numerical methods based on the 
difference approximation of the derivatives. This ap- 
proach is. known as the difference method, or the method 
of finite differences. 

To cut down the computations, we shall illustrate this 
method using the simplest equations (for which, maybe, 
an exact solution has been obtained), bearing in mind 
that the main principles of constructing difference 
schemes can be extended to more general equations. 

Consider a linear differential equation written in the 
following symbolic form: 

Lu (x, y) = f {x, y), (t, y) 6 D. (1) 

Here u is the required solution of the equation, L is a 
differential operator symbolizing the corresponding oper- 
ation of differentiation, and / is the right-hand side of 
the equation (the given function). 

As is known, for the solution of equation (1) to be 
unique, it must be supplemenled witli the boundary 
and initial conditions. We .write these conditions in tlie 
form of a symbolic relation 

lu {x, y) = cp {x. y), (x, y) 6 F, (2) 

where Z is an operator symbolizing the left-hand side 
of the boundary condition, 9 is the right-hand side of the 
boundary condition (the given function) and F is the 
boundary of the domain D\ 

We shall illustrate the principal concepts of the method 
of finite differences by the solution of the Dirichlet 
problem for the Laplace equation in the square 
{0<a:<l,0<i/<l} with the boundary F® {a: == 
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0, X = i, 0^ 1; y = 0, y = 1, 0^ a;^ 1): 

Lu = Uxx + Uyy = 0, (x, y) £ D®, (3) 

M y) = -| ary (x + 1) (y + 1), (x, y) £ T®. (4) 

Thus, for problem (3), (4), the operator L transforms 
the function u into a differential expression u^x + Uyy. 
In such cases wc write that 

r _ 

~ dx^ dy^ ’ 


the right-hand side of the equation / ~ 0, the operator 
of the boundary conditions is an identity operator, i.e. 
it transforms the function u into u\ lu = u, the right- 
hand side of the boundary condition has the form 


4i(x, y) = 


0, X — 0, 0 ^ y ^ 1, 

0, 0^x^l,y — 0, 

0<y <l, 

-|-x(x-l-l), 0<x<l, y-=l. 


The difference method of solving problem (1), (2) can 
be presented as two stages: 

(1) constructing the difference scheme which approxi- 
mates the given continuous problem, 

(2) solving the difference problem and estimating the 
error of the solution. 

We shall dwell on these problems in more detail. 

When constructing the difference scheme, the first 
step is to replace the domain D of the continuous varia- 
tion of the arguments by the domain of their discrete 
variation, i.e. by the net domain (or simply net) w/,, 
i.e. by the set of points (x„, y,„) called the nodal points, 
or nodes, of the net. For the square D® the net domain can 
be constructed as follows. We draw straight lines 

x„ = nh, Pm = mh {h — l/N, n, m = 0, i, . . ., N). 

( 5 ) 



Gh. 10. Solving Partial Differential Equations 485 

The set of intersection points i/^^) of these straight 
lines constitutes the net domain 0 )/^ and the points them- 
selves form the nodes of the net. Every function v {x, y)^ 
defined on the net O/i, is a net function and is often desig- 
nated as Vh, 

The second step in constructing the difference scheme 
is the approximation (approximate replacement) of tlie 
differential expression Lu by a difference expression and 
the function / of the continuous argument by a net func- 
tion, i.e in constructing a difference analogue for equa- 
tion (1). The same refers to the boundary conditions (2). 

Such an approximation leads to a system of algebraic 
equations with respect to the values of the net function 
We can write this system of equations as 

— fhi (^>) 

hi^h = fp/i» (7) 

where Lf^ and cp/^ are difference operators* wliicli approx- 
imate L and i respectively, is the required net func- 
tion which approximates the solution w, f^ and ip/j are 
the given net functions which approximate / and tp 
respectively. 

The collection of the* difference equations (6), (7) 
which approximate the original problem (1), (2) is known 
as the difference scheme. Note that, in general, the origi- 
nal problem can be approximated by different difference 
schemes and one and the same difference scheme can ap- 
proximate different continuous problems. 

By way of example, we construct a difference scheme 
for problem (3), (4). 

For the solution u {x, y) we construct a net function 
Uh defined as follows: Uh (^n» .Vm) = (^n» 1/m)- In what 

follows, in order to simplify the notation (where no 
ambiguity arises), wo shall omit the index h in the net 
functions and especially in their values. Thus Unm ~ 
{Xj^, y^n). Using this notation, we approximate 
every derivative from equation (3) by a difference rela- 


• Note that we understand the concept of the operator here 
as the abbreviation of the symbolic notation for differential aqd 
difference expressions, 
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tion: 

^xx (^n» I/m) — ’4" ^n+i,m)» 

^yyi^n. Urn) ^ “J^jT + ^n,m+l)* (^) 

Then we can approximate the differential equation (3) 
by the difference equations 

“^ 2 ” (*^n-l,m “4“ ^TifTn-i “1“ ^7i+l,m "h t^n,m+l ^^nm) “ ® (9) 

{n, m~if 2, . . ., A^ — 1). 

Hence we have 

I 

^nm = ^l,m "i" *^7i,m+l) (10) 

(W, W= 1, 2, . . ., TV— 1). 

The boundary condition (4) can be approximated as 
follows: 

1. 1 m(m4-iV) ,, 1 n{n-\-N) 

^Nm 2 — 2 TV* 

(«, m = 0, 1, . . TV). (11) 

The system of equations (10), (11) is usually solved 
by the method of simple iteration or by Seidel’s method. 

Comparing relations (6), (7) and (9), (11), it is easy 
to understand* the meaning of the difference operators 
and not functions of system (6), (7) and their relations 
with the corresponding operators and functions of prob- 
lem (1), (2). 

The difference expression is a linear combination 

of the values of the net function at some nodes. In partic- 
ular, the difference expression (9) contains live nodes 
(a hve-node scheme) known as a “cross” scheme (Fig. 
10 . 2 ). 

Thus for (TV — 1)^ unknown values ^ = 

1, 2, . . ., TV — 1) of the net function we get a 
system of (TV — 1)^ equations (9) or (10) in which the 
quantities z;om» are defined by the boundary 

9 Qnditions*^ll). We can regard relations (9), (11) as a 
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consistent system of (N i)^ — 4 equations in 
(N + 1 )^ —4 unknowns m = 0, I, . . N), 

except for Uqq, Uqn, u^q. 

Intuition prompts us that the more accurate the approx- 
imation of type (8), the closer the function to 
Therefore, at this stage we introduce a strict concept of 
approximation. 

The solution Uh of problem (6), (7) is a net function and, 
consequently, it depends on the parameter fe, i.e. on the 

of7,m+l 

0—0 o 

n-1,m nm n+t,m 

°n, m-1 


Fig. 10.2 

Step of the net. A natural question arises concerning the 
possibility, in principle, to approximate the solution 
u (a:, y) of problem (1), (2) by the solution in a finite 
number of actions by choosing an appropriate stepsize 
h. 

We shall compare two net functions VJ^ and Uh = 
u {x, ij), (x, y) ^ (O/j. To find how close the two net 
functions are, we define the concept of the norm on the 
set of net functions as follows: 

||y,,||= max_ \v{x, y)\. (12) 

(X, 

In definition (12) we take the maximum over the domain 
of definition of the function which is under the sign of 
the norm. 

Let us consider tlie error of llie difference scheme (6), 
(7): Vii —un- Substituting Oj, ^ 4- into (6), 

(7), we get, for Z/^, a problem similar to that for v^: 

The right-hand sides of equations (13), (14) constitute 
the error of approximation of equation (1) by the difference 
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equation (6) and the error of approximation of the bounda- 
ry condition (2) by the difference condition (7) on the so- 
lution of the original problem (1), (2). 

We say that the difference scheme (6), (7) approximates 
problem (1), (2) with the order A: >0 relative to h on the 
solution u (x, y) if 

ll/h — -f-hW/ill < lltpft— Z^UaII < Cjh'*, (15) 

where Ci and Cg are constants independent of fe. 

We shall determine the order of approximation for the 
scheme (9), (11), or, which is the same, (10), (11). Since 
the boundary conditions are exactly defined on the net, 
the left-hand side of the second inequality (15) is zero 
and the order of approximation is defined by the first 
inequality (15). 

The right-hand side of equation (3) is zero and there- 
fore we only estimate the norm of 

We use Taylor’s formula: 


«n±l.m--Wnm±^ (3“ (4^), 

, I d^u \ , \ 

6 \ Inm' 24 \ dx^ ) 

4 M (x„ ± 0jft, 0 < ei< 1 , 


d: 

xy 


/ d^u \dh 
\ dx* Jxv 


^n,m±l ^nm 


d*u \± _ a* 

Sy* )xy~ ()y* 


-u h l—\ 4- ^ 

^ \dy Inm'^ 2 \ dy^ ) nm 

■ ft* / d^u \ ■ k* I d*u \ ± 

6 \ )nm ' 24 \ dy* j xy’ 

Uix^y ljjn±%h)y O<02<1. 


Summing up these four relations, we obtain 


= 4u„^ -f h^ [(«,,)„„ -I- (u,,)„„] + [ ( ^ ) 


+ 

xy 


Using the difference relations (9), we find that 

IIMilK-yM,, 


( 16 ) 
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here 


71/4 =- max 

(x, u)eD 




assume 


here 


the existence of the corresponding derivatives. Thus 
scheme (9), (11) has the second order of approximation. 

This completes the discussion of the first stage, i.e. 
the construction of a difference scljeme, and now we pass 
to the second stage, the solution of the difference problem 
and evaluation of the error. 

The most significant problems that arise at this stage 
are those of the solvability of the difference problem, the 
uniqueness of its solution and the continuous dependence 
of the solution on the input data. The input data are 
the right-hand sides of the difference equations and the 
boundary and initial conditions of the difference problem. 
We can formulate the concept of the correctness of a 
difference scheme in the same way as we pose the question 
concerning the correctness of problems of mathematical 
physics. Let be a solution and ff^ and cp/^ the input data 
of a difference' problem (G), (7). The solution and the in- 
put data evidently depend on h. 

Wo say that a difference problem {scheme) is correct 
if the following conditions are fuHilled for all h 
(ho > 0 ): 

(1°) a solution of the difference problem exists and is 
unique, 

(2°) the solution of the difference problem continuously 
depends on the input data. 

We can write condition 2® for the difference problem 
(6), (7) as follows: 


II vn — y* IK Ml II /a — /a II -1- M 2 II (Pa — *P/i IN (17) 

where the symbols without a bar correspond to one prob- 
lem and those with a bar to the other. 

This condition is known as the stability of a difference 
problem (scheme) with respect to the input data^ or simply 
the stability. 

It is proved in the theory of difference schemes that 
the “cross” scheme, constructed for Dirichlet’s problem, 
is correct for Laplace’s equation (and, in general, for 
Poisson’s equation). 

Having formulated the concepts of approximation and 
stability for diff^rf.nce schemes, we firi'ive at the piost 
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significant problem, that of the convergence of the solu- 
tion of the difference problem (6), (7) to the solution of 
the continuous problem (1), (2). 

We say that the difference scheme (6), (7) converges at the 
rate o/ s >. 0 relative to h if the condition 

II Vh — wa IK ch* 

is satisfied, where c is a constant independent of h. 
There is a close relationship between the concepts of 
approximation, correctness and stability which is de- 
fined by the following theorem. 

Theorem. Let the difference problem (6), (7) approximate 
problem (1), (2) on the solution u {x, y) with the order of 
k >0 relative to h and be correct. Then: this scheme con- 
verges with the order equal to the order of approximation k, 
i.e. the estimate 

\\vn-un\\^ch^ (18) 

is satisfied. 

□ By the delinition of approximation wo have 

Wfh — LhUhW < Ci/i*, |l(pA — IhUhll < Cah", 


Using relations (13) and (14), we obtain 

II 11^ II 11^ 


Then, by virtue of the assuinplion of the stability for the 
difference schdme [relation (17)], we have 

II II < M, II II + M, II hzn II , 

whence, using the estimate just obtained, we find that 

II II = II — Uk IK = ch^. ■ 

Example 1. Find the solution of problems (3), (4): 

*^aeae4“ =Q» (^» V) 

" (*. y)=\xy (* H 1) (</ + !)• (*. y) G r®. 


Here Z)® is asquare {0 < a: < 1, 0 < y < 1} with the boundary F® 

(a: = 0, ® = 1, 0^ 1, = 0, {, = 1, 0< 1). 
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• A The system of tho finite-difference eauations has been written 
for this problem in the general case and nas the form 

1 

= Tn~\~^n+t$ m+l) 

(ra; m = l, 2, ^—1), 

(*^om = 

1 m(m-\-N) 1 

— "2 ^ 

(n\ m = 0, 1, N), 

Assuming h = 1/3 (7\r = 3) as tho stepsize of the net, we construct 
a tabic of boundary conditions and unknown values: 


Table 10.1 



0.222 

0.550 


0 

^12 

*^22 

0.556 

0 

^11 

1^21 

■Bl 


1 

I 

0 



TJie initial system of equations for tho unknown values assumes 
the form 


i;i 1 = -^ (I) -}- V21 + 9 V12) 

Ui2 = -^ (0 1722 + i;i 1 + 0.222), 

l’21 = 4(''ll + "-222 + " + l’22). 

•’22 = 4 (•'la + ■ 1 ■ • 

Let us now use the method of simple iteration to solve this 
system. To do this, we have to get the initial values of the un- 
knowns. We shall obtain them by means of a linear interpolation 
using the boundary conditions, first for the rows and then for the 
columns. 

We shall carry out the linear interpolation for the rows using 
the formula 


^nm — ^om + {^Nm — ^om) • 

This yields (/i, m = 1, 2) 

U 12 = 0.185, ^22 “ 0.371, i;^ = 0.074, = 0,148, 
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We shall carry out the linear interpolation for the columns using 
the formula 

^nm — ^no “h (^nN *^jio) , 

This yields (n, m, = 1, 2) 

Vi2 = 0.148, yji == 0.074, Z 22 = 0.371, u^i 0.185. 

Wc take the half-sum of tho values obtained 

i^nm — — {Vnm ^nm) » 

i.e. v ^2 = *^21 “ 0.166, = 0.371, yjj — 0.074, as the initial 

values. 

Wf’ can now perform the iteration process: 

*^i2» "“7“ (^11 


— -L 

^22 “Y 


(a?2H-0.556). 


We have used the symmetry of the initial data (v ^2 ~ ^ 21 ) ®nd 
of the system of equations. Wc shall continue with the solution of 
this system until two successive iterations coincide with an accura- 
cy of 0.001. The results of calculations are in Table 10.2. 

Tabic 10,2 



Two iterations proved to be sufficient to get a solution. This 
speaks of the simplicity of the difference problem due to the largo 
stepsize of the net. A 

Example 2. Find a solution of Laplace’s equation (3) in a unit 
square under the following boundary conditions: 

0, 0 ^ X ^ 1, [/ = 0, 

y (64i/2_60y + 29), x = 0, 0<y<l, 

y)=-- ^ 

-|-(1- a:) (64x2-68x4-33), 0<x<l, y = l, 

*’ 1 0 f=l, 
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A We set h = 0.25 and construct system (10) taking the boun- 
dary conditions into account: 

^?+‘=-i-(12+4i+0 + «;?2). 

'^21’* = 4" ‘'31+^ + ‘'22)' 

'’31’* = x(''2‘ +” + ® + ‘'32)==4‘ "21’ 

« 12 +‘=T (20 + 1’|2 + '^ 1 +«'? 3 ). 

''22 * = ( ‘’l2 + '^32 + ''23't"‘'2l)“ ~2 (‘'l2 + ‘'2l)< 

"u ‘ = T (4'>+.;t8+'’t2+'*«)=2n+ i- 


Tlio boundary conditions and the unknown values are given in 
Table 10.3. 


Table 10.3 



We have used the symmetry property, v^m = ^N-m^N-n^ 
construct this system. 

We shall calculate the initial approximation with the aid of the 
linear interpolation using the boundary conditions at the interior 
nodes. Using the formula 



"^1 = 12 1 

1‘-t) 


to calculate 

,, we get i>J, = 9 

, i>gi = 6, 

vj, = 3. By virtue of 

symmetry, we 

set = yg, = 

11 

e?, - 9. 

Using the 

formula 




•’X2 = 2»( 

, 7 

* 30 " 

) 
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to calculate and yjj, wo get i;j2 = 15.33, i;Ja = 10.G6. By virtue 
of symetry wo set 17^3 = yjg = 15.33. 

The last value, i;j3, we get from the formula 


r,0 = 


^13 


= +40- 


40—15.33 


1=27.67. 


We shall use two methods to solve this system: the method of 
simple iteration (Table 10.4) and Seidel’s method (Table 10.5). We 
shall continue the calculations until two successive solutions for 
each variable coincide with an accuracy of 0.1. The method of sim- 
ple iteration required four iterations and Seidel’s method required 
three. 

The final solutions are given in Tables 10.4 and 10.5. ^ 


Table 10.4 



40 

20 

12 


40 

28.5 

17.0 

8.6 

0 

‘ 

20 

17.0 

11.3 

5.6 

0 

12 

8.6 

5.6 

2.8 

1 0 


0 

0 

0 



Table 10,5 



. 40 

20 

12 


40 

28.6 

17.0 

8.6 

0 

20 

17.0 

11.4 

5.7 , 

0 

12 . 

8.6 . 

5.7 

2.8 

0 


0 

0 

0 



10.5. Difference Schemes for Solving the Equation of 
Heat Conduction 

Let us Consider the first bound ary- value problem for 
the equation of heat conduction in a rectangle Z) {0:^ 
We have to find a solution of the 
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problem 

Lu = Ui — Mjcx = / (0 < x C. 1, 0 < T), (1) 

u {x, 0) = Uq (a;) (0< 1), (2) 

u (0, t) = (po (f), u (1, t) = ^0 (0 (0^ T) (3) 


continuous in Z>. 

As we did in 10.4 for Poisson’s equation, we use the 
difference method to construct the solution of problem 

(l)-(3). __ I 

In the domain Z), we introduce a uniform rectangular 
net (O/ix ^k) with the stepsize h = MN with respect 
to the coordinate x and with the stepsize t = TIM with 
respect to the coorejinate t: 

Xn = nh {n = 0, i, . . N), = kx {k == 0, 1, ... M). 


We approximate the derivatives of the left-hand side 
of equation (1) by the following difference expressions: 


(u,)* ^ — 2- , or (m,)* ^ 

(U »n-l-24+>*n+l • 

\^xx)n = ^2 • 



(4) 


In accordance with approximation (4) we construct two 
difference analogues of equation (1) with the unknown net 
function v.^^: 


LihVhx - 


n n 


‘'n-1 


—2vIA- v\ 


71+1 




=-L (5) 


r .. "n-'4 ‘ 

; -p “/«• (o) 


Here are tile' values of a net function corresponding 
to the right-hand side of equation (l), say, /^ — / (x„, #*). 

Wc usually assume /J = / t/i +-|-) for scheme (5) 

and /* = / for scheme (6). 

We can exactly define the initial and the boundary con- 
dition for the first boundary-value problem: 

= Wo (nh) (n = 0, 1, . N), 

Wo* ^ 9o (At), w* = ipo (At), (A = 0, 1, . . ., M). (7) 
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In the case of the second and third bound ary-value prob- 
lems, the boundary conditions are approximated with the 
use of formulas similar to relation (4). 

Four-point schemes (5) and (6) are shown in Fig. 10.3. 

Scheme (5) is explicit and scheme (6) is implicit. 

This definition is due to the fact that scheme (5) in the 
explicit form defines the successive, in time, values of 


o n, ^+1 

O 6-- - ■ o 

n-1, /f nK 


n-1,k nk n+1, k 

O n O 


6 

n, k~1 


Fig. 10.3 

the unknown net function relative to the preceding val- 
ues. Indeed, setting r = r/Zi^, it is easy to find from re- 
lation (5) that 

— r (l^n-l + ^^n+l) + (1 — 2r) (8) 

Thus, using conditions (7) and the explicit formula (8), 
we can find, in succession, any value yj. Consequently, a 
solution of system (7), (8) exists and is unique. 

It is different with scheme (6). We rewrite it as follows: 

1 ^ (1 + 2r) = - (i;^ ‘ + rf^). (9) 

This scheme yields the values of the required net function 
in an implicit form, i.e. as a system of equations. We 
can show that a solution of system (7), (9) exists and is 
unique. It is usually found by the method of factoriza- 
tion which we shall not consider here. 

The order of approximation for schemes (5) and (6) 
can be determined with the use of the appropriate Tay- 
lor’s formulas in the same way as we did for Poisson’s 
equation in 10.4. As a result we find that the difference 
schemes (5), (7) and (6), (7) approximate problem (1)- 
(3) with an error 0 (t A®), i.e. 

-/ftT IK M (T -f- A2). (10) 

The theory of difierence schemes proves the validity 
of the<«following properties. 

1®. For 1/2, the explicit scheme (5), (7) hasaunique 
solution and is stable, and for il2 it is unstable. 
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2°. The implicit scheme (6), (7) has a unique solution 
and is stable for any r. 

Thus, on the basis of the theorem from 10.4, relation 
(10) and the properties just formulated, we can assert 
the convergence of the explicit scheme for 1/2 and 
the implicit scheme for any h and t with the error 
O (t + /^2). 

Example. Solve problem (l)-(3) for / = 0, = 2 : (1 — j:), (po = 

% = 0 , 7 ’ - 0 . 1 . 

A In this caso oquation (1) and conditions (2), (3) assume the 
form 

ut — Uxx = 0(0<Ca:<Cl, 0<Ci^ 0.1), 

u (x, 0) = X (i — x) (0^ x^ 1 ), 
u (0, <) = u (1, f) = 0 (0 < 0.1). 

We take the explicit^ scheme (8) as the scheme for computations. 
We set h = 0.25 and then 0.03. Since T — 0.1, we take t = 
0.025 for M to be an integer (M — 4). We find that = 0.4. 

The computational formula has the form 

i + «^n+i)+'>-24 (« = 1. 2, 3, k =0, 1, 2, 3), 

■'«=" 2, 3, k^.i, 2, 3, 4). 

Thus we get initial conditions — 0.1875, == 0.2500, i;!{ = 

0.1875 and boundary conditions u\ = yj = 0. 

At the first step we have 

v\ =0.4 ( yg + y®) -I- 0.2yJ - 0.1375, 

yj =0,4 (yj I- y5)-h().2y2 =0.2000. 

By virtue of symmetry yj = y{ = 0.1375. The calculations at 
the next steps are similar. 

All the calculations are given in Table 10.6, ^ 

Table 10.6 


k 

0 

1 

2 

3 

4 

A 

0 

0 

0 

0 


A 

0.1875 

0.1375 

0.1075 

0.0815 

0.0627 

lA 

0.2500 

().2(MH) 

O.15O0 

0.1100 

0.0884 


0.1875 

^0.1375 

0.1075 

^ 0.0815 

0.0627 


0 

0 

0 - 

0 



32-0104 
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10.6. Difference Schemes for Solving the Equation of 
Oscillation of a String 

Let us consider the first boundary-value problem for 
^he equation of the oscillation of a string in a rectangle 
D 0^ T}. We have to find a solution 

of the problem 

Lu = utt—Uxx = f (0 < » < 1, 0 < r), (1) 

u (x, 0) = (x), Ut (x, 0) = Ui (x) (0^ x^ 1), (2) 

w (0. t) = <Po (t), u (1, t) = ilJo (t) (0< T) (3) 


continuous in D. 

The application of the method of finite differences to 
the solution of problem (l)-(3) differs but slightly from 
its application to the equation of heat conduction*. 
The domain D is covered by a net The difference is 
in the approximation of the second derivative with re- 
spect to the variable t: 


(Utt)n 





( 4 ) 


The difference approximation of the equation assumes 
the form 




T* 


=^-/^ ( 5 ) 


The initial conditions arc approximated as follows: 
t;^ = Uo(/ife), - - = u, (nh) (n = 0, 1, iV). (6) 


The boundary conditions are approximated in the same 
way as for the equation of heat conduction; 

i;o = q>o(AT), vn^'Po(^) (ft = 0, 1, M). (7) 

Five-point scheme (5) of the “cross” type is shown in 
Fig. 10.2. 

— 

* In this section we use designations and concepts accepted 
in 10.4 and 10.5. 
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The quantity is an apparent (dummy) unknown 
whicli can be found from relation (6) and substituted into 
equation (5). In this case we get a simple explicit scheme 

(Y = T//i): 

^ - 1 “f 4- 1 ) + 2 (1 — Y^) • 

(8) 

The order of approximation of the difference sclieme 
(6)-(8) can be found in the same way as it was done in 
10.4 for Laplace’s equation. The verification shows that 
the error of the approximation scheme (6)-(8) is O (t‘^ + 
and in addition, this scheme is stable for = 
{xlhY^ 1/(1 -\- e), e >0. Thus it converges with an 
error of the order of O ( t ‘^ -|- h^) under the indicated con- 
dition. 

Example. Solve problem (l)-(3) for / = 0, Wq — a: (1 — a:), = 

9o *^0 = 0 . 6 . 

A We set h = 0.25 and then t < 0.25. Since T = 0.6, we take 
T = 0.2 fer to ho an integer (Af — 3). We calculate 
(x//i)2 — 0.64. The computational formula has the form 


■'n (" = 1. 2, 3), 


mO - 


M (4 — n) 


16 


0.2 


.0 (/1--0, 1, 2, 3, 4). 


_ 


0 1, 2, 3, 4). 


Tims we get initial conditions i;J — 0.188, = 0.250, i;§ = 

0. 188, ~ v'n and boundary coiulitions = i) (A: = 0, 

1, 2, 3, 4). 

At the first step wo need the value of the apparent quantity 
to calculate u\. We find it from the initial condition i;7^ — p*. Thus 
at the first step we have 

1 + M ) + ''•V2^«. 

Hence 

v] = 0.32 (ag + ag) + 0.36a! - 0.148, 
ai = 0.32 (a? + ag) -| - i).36ag = 0.210. 

By virtue of the symmetry of the problem, aj = v\ = 0.148. 

At the second step we obtain 

v\ ^ - aj + 0.64 (aj - (- +0.72a{ = 0.053, 
vl=~vi + 0.64 (al+ vl) + 0.72aJ = 0.091 . 

By virtue of the symmetry of the problem, ag = a? = 0.053. By 
analogy we make calculations at the next steeps. 

All the calculations are shown in Table 10.7. 


32 * 
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Table 10,7 


k 

0 

1 

2 

3 


0 

0 

0 

0 

A 

0.188 

0.148 

0.053 

-0.052 


0.250 

0.210 

0.091 

-0.077 


0.188 

0.148 

0.053 

-0.052 


0 

0 

0 

0 


Exercises 

1, Find an approximate solution of the Laplace equation 
for a square under the indicaled boundary 

Ox^ aij^ 

conditions: 

.(a) (b) 


16.18 

38.63 


17.98 

39.02 

0.00 # • 

• 

• 50.00 0.00 • 

• 

• • .50.00 

O.fM) • O 

o 

• 30.10 0.00 • 

o 

o • 30.10 

0.00 • o 

■ o 

• 12.38 0.00 • 

o 

O • 12.38 

0 .00 • • 

• 

• 4.31 0.00 • 

• 

• • 4.31 

26.15 

29.34 


29.05 

29.63 

2, Find an 

approximate solution of 

the Laplace equation 

(J^u . d^u 

a stepsizc h^i/(j for a square under the 

indicated boundary conditions: 




9.81 

19.78 29.12 40.16 

42.31 


O.OOx 

X 

XXX 

X 

X50.0() 

0.(M)X 

O 

O O O 

O 

X40.16 

O.OOx 

o 

O O O 

O 

X33.ll 

O.OOx 

o 

O O O 

O 

X19.14 

O.OOX 

o 

O 0 o 

o 

X13.00 

Oj^Ox 

o 

o o o 

o 

X6.98 

o;6ox 

X 

XXX 

X 

X4.31 


17.28 

31.96 40.00 3^t.50 

17.28 
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3. Find an approximate solution of the equation 

which satisfies the conditions u (x, 0) — (x), u (0, t) = /„ (/), 
u {i, t) = fi (0 for the values 0^ T, taking a step h — OA 
with respect to the argument x. Consider two variants of the bound- 
ary conditions: 

(a) go W -1- 1-1) sinjix, /„ (0 - /^ (/) - 0 , r- 

0.02, r = 1/2. 

(b) go (x) = (1.1^" + 2.3) e-x, /o (t) - 2,3, f, (t) - 3.4e-i, 

-= 0.01, r = 1/0. 



Answers to Exercises 


Chapter 1 

1. (a) 2.7546, 2.755, 2.75, 2.8, 3, (b) 3.1416, 3.142, 3.14, 3.1, 3, 

(c) 0.5645, 0.565, 0.56, 0.6, 1. (d) 4.194, 4.19, 4.2, 4, (c) 0.6065, 

0.607,0.61,0.6,1. 2. (a) 1.14, A. = 0.0026, 6. = 0.23% , (b) 0.0102, 
\ = 0.00005, 6. = 0.5%, (c) 0.124, A. - 0.0005, = 0.41%, 

(d) 922, A„-0.45, 6^ = 0.049%, (e) 0.00246, A^ = 0.000002, 
6. = 0.082O/0. 3. (a) 0.018, (b) 0.099, (c) 0.047, (d) 2.0, (e) 0.00035. 
4. (a) 3, (b) 4, (c) 3,(d)2, (e) 3. 5. (a) The second, (b) the second, (c) the 
first, (d) the second, (e) the second. 6. a = 47.5. 7. 46.39. 8. 3.29. 

9. A,, = 0.0005, 6^ = 0.0075%, (b) A„ = 0.0005, 6. = 0.003%. 

10. (a) ij = 0.085, A„ = 0.0012, dy = 1.4%, (b) y ~ 1.20, Ay = 

0.056, dy = 4J%, (c) y = 0.0552, A„ = 0.00043, = 0.77%, 

(d) y = 2.747, A. -= 0.0090, --- 0.33: 11. (a) s - 0.594, (b) 5 -= 

0.687. 

Chapter 2 

[6 2 4;] [1 5—5' 

1. (a) 9 9 6 , (b) 3 10 0 , 

LS 9 1 J 12 9-7 


S -56 54"] [ -72 -72 78 

2. (a) -30 -100 146 , (b) 36 54 -6 

L 118 -82 28 J [66 240 88, 
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(c) A-^ = 


7. AB= 


r 24 0 0 0-1 

1 0 12 0 0 I 

24 -12 9 6 0 ■ 

_ -28 -5 2 8 J 


24 57 15 31 
-4 16 6 11 
16 27 7 14 
10 53 13 29 


8. (a) ^-1= ^ 


12 3 2 

2- 1 2-3 

3- 2-1 2 

-2—3 2 1 




6-4 0 8 

-12 5 9 -1 

-12 11 9 -13 

-6-5 9 1 


9. (a) A = TJ^ = 


0 0 
0 0 
-18/5 0 
36/5 18 


12 3 -2 

0 1 8/5 -1/5 
0 0 1 -2 
0 0 0 1 


rl -2 1/5 2-1 r 1 0 

0 1 8/5 -o j 2/5 -1/5 0 

0 0 1 2 7/18 4/18 -5/18 

0 0 0 iJL -2/18 -3/18 2/18 

r 1 2 3 2-1 

1 2-1 2-3 ... . 

18 3-2-1 2 ’ ^ ^ 

-2-3 2 1 J 


0 0 - 
0 0 
5/18 0 
2/18 1/18 _ 
r3 0 




2 7/3 0 


1 8/3 -9/7 


1 -2/3 2/3 0 - 

0 1 -1/7 -6/7 

0 0 1 13 ’ * ‘ 

0 0 0 1 _ 

12/3-4/7 8-|r 1/3 0 0 0 

0 1 1/7 -1 -2/7 3/7 0 0 

0 0 1 -13 -5 —3 7 0 

0 0 0 1 JL “1/3 -5/18 9/18 1/18 


6-4 0 8 

-12 5 9 -1 

-12 11 9 -13 

-6 -5 9 1 


, 10. (a) X = 


= -1 2 I 

.5 7 ij 


‘ 0-1 2 ' 

X= 1 0 -2 , 11. 

,3 1 2_ 


(b) X = 


(a) r=2, (b) r=2. 12. It is linearly 
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dependent, (b) it is linearly independent. 13.. The basis is com- 
posed, say, of the vectors Xj, Xg, X4; X3 = Xi — Xg. 14. y = (5/4, 1/4; 
—1/4, —1/4). 


Chapter 3 

1. (a) = — (11/7)0:3, f 2 = — (1/7 )o:3 , (b) Xi = (3x3 — 

13 x 4)/17 , Xj == ( 19x3 — 20x4)/!?. 2. The general solution is Xj = 
(X3 — 9x4 — 2)/ll, X2 = (— Sxg + X4 + 10)/11; the particular solu- 
tion is xi = — 1, X2=l, X3 = 0, X4 = l, (b) the general solution is 
xg = 22xi — 33x2 “ 11» ^4 = — 163:1 + 24x2 + 8, the particular 
solution is Xi = 1, Xg = 0, Xg = 11, X4 = — 8 . 3. (a) Xi = 0, 
Xg = —1, 0:3 = 2, (b) X = 2, y = —2, z = 1. 4. (a) Xi = 1, 

Xg ”1, Xg 1, X 4 1, (b) Xi = 1, Xg — 2, Xg = 0, 

X 4 = 3. 5. (a) Xi = 1.120, Xg = — 0.341, Xg = — 0.008, (b) x = 
0.008,- y = —0.231, z = 0.042. 6 . (a) d = 88 , (b) d = 2111.97. 


7. (a) A-i 


r 10/3 

—7/6 

1/2 

— 1/6- 

-5/3 

5/6 

-1/2 

— 7/6 

1 

-1/2 

1/2 

3/2 

1 

-1/2 

1/2 

1/2 _ 


r 1.19 -0.31 -0.82 -0.12 -| 

—0.17 1.57 1.23 0.70 

-1.75 0.11 0.30 0.87 

—0.12 —2.92 -1.09 0.17 


(b) A-i== 


8. (a) xj = -0.72, X2 = 1.88, x., = -0.92, X4 == - 1.94, (b) x -- 

I. 22, y = - 067, z = 0.35. 10. (a) || A I L - 1.9, || A |L - 1.9, 
II A II3 = 2.55, (b) II A 111 = 1.45, || A \U = 1.07, || A II3 = 1.20. 

II. (a) Xj = 1, Xg = — 1, Xg — 2, X4 = 0, (b) Xj — 1/2, Xg “ 3/2, 


Xg = — 1/2, X4 = — 2, 12. (a) xj == — 2, 
X4 = 3, (b) Xl = 1, Xg = 1, Xg —1. 


Xg 2, 


-3, 


Chapter 4 

1. The remainder is r = P5 (3) = 430, the quotient is — 
x4 + 6x3 + 16x3 + 48x + 143. 2. Yes, it is. 3. (a) 0.423, (b) 0.940. 
(c) 1.386, (d) 1.221, (e) 0.809, (f) 0.309. 4. (a) 3.464, (b) 7.483, 
(c) 6.481. 


Chapter 5 

1. (a) - 1.325, (b) 1.180, (c) — 1.876, 0.578, (d) 0.781, 2.401, 
(e) 0.0, 0.399, 6.352, (f) 0.310, 4.0. 2. (a) 1.213, (b) 0.706, (c) 0.841, 
(d) -0.438, 0.438, (e) 0.0, 0.787, (f) 1.897. 3. (a) -4.071, 0.468, 
0.993, (b) —0.695, —3.067, 3.757, (c) —3.523, —1.567, 1.086, 

(d) 0.398, 4.862, (e) 0.0, 2.753, (f) 0.739. 4. (a) 0.760, (b) - 2.258, 

(c) -0.465, (d) -0.567, -0.335, 0.0, (e) 3.473, (f) 1.422. 

5. (a) —0^32, 0.653, 2.879, (b) —0.475, 1.395, (c) -1.582, 

0.402, 1.373, (d) -1.453, 1.164. 6. (a) 0.187, (b) 0.755, (c) 0.739, 

(d) 0.607, (e) 0.672. 
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Chapter 6 

1. (a) A,3~2X2-66X + 1, (b) - 6A. — 41 , (c) + 

16A,*-16. 2. (a) Xi-7, xi = c [ J J , X*=-2, X2 = c[_^], 

(b) Xi-— 2, Xi = ci ^ j j' ^ A,3 + A,a-3X,-7, 

(b) X,« + 8 Xs + 6X,*+ 6^ — 54, (c) X,‘ + X®-6a:S-18X. 4. (a) \* — 
7Xa+15X*-2X-34, (b) X< + X»+7>v*-20X - 54. 6. Z)(X)=. 

Xa-3Xa + 3X-l, Xi = X, = X3=.l, x(i) = xW = x(3)=- ( 1 1, it 


1 . it 
-1 


= 0 . 7. Xi^4.46, X.3-=1.59. 


Chapter 7 

1. 20.819, 2. 24.080. 3. i, (j:) = - (1/15 )j:® - (3/20)i» + 
(241/60)1 - .3,9. 4. L^ix) — 0.073.5** - 0.4530* -|- 0.7474, Aj- 

0.23 X 10 *. 3.37215. 8. 4.379. 9. 1.43612. 10. 0.7.5487. 

13. (a) 0.6115 ± 0.00013, (b) 0.9409 ± 0.0007, (c) 0.9456 ± 
0.002, (d) 0.8007 ± 0.0009, (e) 0.3156 ± 0.00012, (t) 2.4505 ± 

0.0018. 14. Q 2 (*) = 2 — 0.7 cos 2* — 0.3 sin 2* - - 0.3 cos 4* -j- 

fcj sin 4*. 15. C>2 (*) = — 1 + (7/3) cos 2n* — (2/V'^3) sin 2n* — 
cos 4jt*. 

Chapter 8 

1. 15.160. 2. 1.429. 3. 2.28. 4. 2.002. 5. 0.107250. 6. 0.67363. 
7. 0.6931472. 8. 0.007. 9. 0.0087. 10. (a) 0.239, (b) 0.223, (c) 1.000, 
(d) 0.8349, (e) 1.4627, (f) 1.5625, (g) 1.333, (h) 0.460, (i) 1.718. 
11. (a) 0.754 ± 0.002 (for *0 = 3°). (b) —0.471 ± 0.002 (for 

ha ------ 7°), (c) 2.421 ± 0.007 (tor = 1°), (d) 0.953 ± 0.002 

(tor ho -= 6°), (e) 0.892 ± 0.0015 (for /t# = 3"), (c) 1.438 0.003 

(for hg = 3°). 

Chapter 9 

1, (a) y, -I- 8** -I- (56/3)*3 + 18*< + 8*® + (4/3) *», (b) y, - 
1 - - * -I- **■ - (1/3) *8 H- (1/24) X*. 2. y (*) = 1 + 2* - 0.7** - 
0.2567*8 _|_ o.051*« + 0.00147*8 _ o.OOlOl**. 3. y = *8/3 + 
*V63 + . . . 4. (a) yi = - 1.1, y^ = -1.18, y, - -1.238, 
y4 = -1.2718, yj = -1.2790, (b) y, = 0, y.^ = 0,01, y, = 

0.0278, y, = 0.052i,yo -= 0.08192, y, = 0.115536, y, - 0.152429, 
y«- 0.191943, y„ = 0.23.3554, y,o - 0.276844. 5. y„ -- 1, y^ = 
1.1836, y, - 1.3426, y^ -= 1 .48.50, y, ^ 1.61,52, ;/,, - 1.7362. 
6. Vo ^ i.“yi 1.1867, v. ■ 1,3484, y, = 1.4938, 1/4 = 1.6272, 
yo = 1.7,542. 7. (a) y„ • = 0, yi = 0.10,536, y^ - 0.223136, yj = 
0.356601, y. == 0.510424, yj - 0.691497, y, = 0.910454, y, = 
1.184648, ijo = 1.544491, y, -- 2.048721, yi# = 2.827617, (b) y, = 
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2.00, y \ 1.81, ^2 — 1.64, — 1.49, — 1.36, ^5 “ 1.25, 

y ^ = 1.16, y ^ = 1.09, y ^ = 1.04, y ^ = 1.01, 8. y ^ = 0.8110, j/r = 
0.8196, y* = 0.8464, y ^ = 0.8898, y ^ = 0.9480, y ^ = 1.0197, 
^10 = 1.1037. 


Chapter 10 


0.0016.18 

38.63 

50.00 

0.00 

17.88 

j39.92|50.00 

0.00 

14.12 

26.09 

30.10 

0.00 

/V,\ 

15.18 

36.39 

30.10 

0.00 

15.20j 

20.53 

12.38 

0.00 

16.37 

[21.26 

12.38 

o.ooj 

26.15 

29.34 

4.31 

0.00 

29.05 

29.63 

4.31 



9.81 

CO 

00 

29.12 1 

40.16 

42.31 

0.00 

8.97 

17.58 

25.36 

32.18 

36.11 

40.16 

0.00 

8.68 

16.00 

22.29 

26.86 

29.69 

33.11 

0.00 

8.36 

15.59 

20.71 

23.05 

22.62 

19.11 

0.00 

9,45 

17.22 

21.71 

21.85 

18.55 

13.00 

0.00 

12.20 

22,09 

26.96 

24.01 

16.70 

6.98 


17.28 

31.96 

40.00 

30.50 

17.28 



i 

1 

• 2 

3 

4 

5 

6 

7 

8 

9 

0.000 

0.343 

0.672 

0.970 

1.213 

1.375 

1.423 

1.327 

i 1 .062 

0.618 

0.005 

0.336 

0.656 

0.943 

1.172 

1.318 

1.351 

1.243 

0.973 

0.531 

0.010 

0.328 

0.639 

0.914 

1.131 

1.262 

1.281 

1.162 

0.887 

0.486 

0.015 

0.320 

0.621 

0.885 

1,088 

1.206 

1.212 

1.084 

0.824 

0.443 

0.020 

0.311 

0.602 

0.855 

1 .045 

1.150 

1.145 

1.018 

0.764 

0.412 


3. 


0.000 

2.091 

1.919 

1.777 

1.660 

1.562 

1.480 

1.410 

1.350 

1.297 

,^0.017 

2.097 

1.924 

1.781 

1.663 

1.564 

8.482 

1.411 

1.351 

1.298 

(b) 0.033 

2.102 

1.929 

1.785 

1.666 

1.567 

1.484 

1.413 

1.352 

1.299 

0.050 

2.i()6 

1.934 

1.789 

1.670 

1.570 

1.486 

1.415 

1.354 

1.300 

0.067 

2.110 

1.939 

1.794 

1.673 

1.572 

1.488 

1.416 

1.355 

1.301 
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Absolute, error 17 

value of a matrix 89 
of a vector 90 

Adams* extrapolation method 
452, 454, 457 
Adioined matrix 58 
Aitkeu’s iterated interpolation 
339 

Algebraic, adjunct 50 
equation 
function 180 
polynomial 165 

Analytic method of representing 
a function 283 
Approximate, number 14 
value of a number 17 
Arithmetic progression 347 
Augmented matrix of a system 
of equations 110 


Back substitution 127, 130 
Base, equation 115 
minor 99 
unknown 115 

Basic elimination procedure 121 
Bezout’s theorem 168 
Bisection method 194 
Bordered matrix 79 
Bordering 79 
Boundary conditions 475 
Boundary- value problem 4(r5 
classical solution of 476 
homogeneous 467 
linear 467 


Cauchy’s problem 425, 474 
for hyperbolic equations 477 


for parabolic equations 478 
for an unbounded domain 476 
Central difference 309, 311 
Characteristic, determinant 239 
equation 239 
polynomial 239 
value 237 

Chebyshev’s method “of fitting” 
292 

polynomial 341, 342 
Cholcsky’s method 144 
Classical solution of a bounda- 
ry-value problem 476 
Coefficient, of Cotes, 400 
of an equation 181 
of Fourier 351 

of a system of equations 108 
Cofactor 50 
Columns, matrix 40 
vector 40 

Conjugate matrix 58 
Consistent system of equations 
109 

Constant, term 108, 16'> 
unknown 115 
Control sum 130 
Convergent, method 415 
sequence 348 
series 349 

Coordinates of a vector 41, 99 
Cramer’s rule 112 

Deficiency of a matrix 91 
Determinant 48 
principal diagonal of 48 
properties of 52-55 
of the second order 48 
secondary diagonal of 48 
of the third order 49 
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Determinate system of equa- 
tions 109 

Diagonal, matrix 41 
minor 67 

Difference of matrices 43 
Difference, method 483 
problem 489 

Differential equation 423 
degree of 434 
elliptic 472 
hyperbolic 472 
integral of 424 
general 424 
ordijiary 423 
of order n 424 
parabolic 472 
partial 423 
solution of 424 
Dimensions, of a matrix 4U 
of space 98 

Dirichlet’s problem 479 
Discriminant 472 
Divergent, sequence 348 
series 349 

Divided difference 329 
of order zero *329 
Domain, of convergence of a 
functional series 350 
of definition of a function 
190 

of existence of a function 
190 

of permissible values of an 
equation 179 
Doubtful digit 21 

Eigenvalue 237 
Eigenvector 237 
Elementary transformation, of 
a determinant 55 
of a matrix 93 
of a system of equations 
109 

Elements of a vector 41 
Equal matrices 42 
Equation, of heat conduction 
474 

of Laplace 478 
of oscillation of a string 474 
of Poisson ^74 

Equispaced interpolation nodal 
points 307 


Equivalent, matrices 93 
systems of equations 109 
Error 17 

of approximation 15 
of a boundary condition 
488 

of an equation 487 
of interpolation 295, 297 
of a method 15 
of rounding 15 
Euler’s, broken line 436 
method 434 

Exact method of solving a pro- 
blem 240 

Expansion, of a determinant 
according to the ele- 
ments of a row (co- 
lumn) 51 

of a function in a Fourier 
series 351 
Extrapolation 293 


Finite difference 289, 309 
backward 309, 311 
central 309, 311 
forward 309, 311 
Finite-dimensional space 98 
Formula, of Adams 454 
of Gauss 410 
rectangular 382, 384 
of Simpson 402 
compounded 418 
Forward substitution 127, 130 
Fourier, analysis 357 
coefficient 351 
series 351 

Free term of a system of equa- 
tions 108 

Frobenius matrix 261 
Function 283 

Functional dependence 283 
sequence 348 
series 349 

trigonometric 351 
Fundamental, system of equa- 
tions 118 

theorem of algebra 224 


Gauss’ scheme 127 
Gaussian, elimination 124 
quadrature formula 410 



General, integral of a differen- 
tial equation 424 
solution of a differential equa- 
tion 424 

Generalized Horner’s scheme 
170 

Geometric progression 347 
Graph of a function 284 
Graphical method, of represent- 
ing a function 284 
of separating roots 184 


Harmonic, analysis 347 
function 480 
Hermite polynomial 345 
Homogeneous, boundary-value 
problem 407 

system of equations 109 
Horner’s, method 231 
scheme 107 
Hyper matrix 78 


Identity matrix 41 
Implicit scheme 496 
Incompatible system of equa- 
tions 109 

Inconsistent system of equa- 
tions 109 

Indeterminate system of equa- 
tions 109 

Infinite-dimensional space 98 
Initial, conditions 425, 474 
data 425 
interval 454 
value 425 

Initial-value problem 425 
Input data 481, 482, 489 
Integral, curve 424 
rational function 180 
Interpolation 293 
backward 366 
error of 295 
formula 398 
linear 297 
in narrow sense 293 
by polynomials 294 
quadratic 297 

in the sense of Hermite 345 
in the sense of Lagrange 345 
in tables 336 


Interpolation polynomial 295 
Bessel’s 322, 323 
Lagrange’s 304, 306 
Newton’s 325, 326 
Stirling’s 320, 322 
Inverse matrix 57 
Inversion of a matrix 57 
by expanding it in a product 
of two triangular mat- 
rices 72 

by partitioning it into blocks 
82 

by successive bordering 85 
Invertible matrix 57 
Irrational function 181 
Iterative, method of solving 
a problem 241 
process 148 


Kronecker-Capell i theorem 110 
Kronecker delta 139 

Lagrange’s multiplier 304 
X-differenco 279 
Limit of a sequence 3^i8 
Linear, boundary-value 
problem 467 

combination of vectors 96 
dependence of vectors 96 
independence of vectors 96 
interpolation 297 
space 95 

Linearly independent equations 
115 

Lipschitz condition 425 
Loss of accuracy 26 
Lower triangular matrix 66 

Mantissa of a uumb(»r 20 
Matrix 40 
equation 63-66 
of Frobenius 261 
square 41 

of a system of equations 109 
of transformation of an old 
basis into a new one 
101 

Method, of Adams 452, 454, 457 
of Aitken 339 
of bisection 194 
of bordering 92 
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of chords 197 
of Danilevsky 260, 263, 270- 
274 

of direct expansion 241 
of Euler 434 
modifications of 439 
of Euler-Cauchy 441 
of finite differences 483 
of Horner 231 
of iterations 148-150, 176, 
214, 277 

of separating roots 184 
analytical 189 
graphical 184 
of Krylov 245, 253 

of Lagrange, of finding the 

upper bound of posi- 

tive roots of an equa- 
tion 229 

of least squares 294 
of Leverrier-Faddeev 254, 258 
of Milne 459 

of Newton, of finding the 

upper . bound of posi- 
tive roots of an equa- 
tion 230 

of partitioning into blocks 82 
of Pickard 426 
of representing a function 284 
analytical 282 
graphical 284 
tabular 284 
of Seidel 156-^59 
of successive, differentiation 
430 

approximation 148-150, 170 
214 

bordering 85 

elimination of unknowns 
124 

of tangents 203 

of undetermined coefficients 432 
Methods of representing a func- 
tional relation 283 
analytical 283 
graphical 284 
tabular 284 

Minor, of an element of a deter- 
mi^nt 50 

of order A; of a matrix 91 
Mixed boundary-value problem 
467 


Monotonic function 190 
re-dimensional linear space 98 
Natural scale 347 
Net 484 
domain 484 
function 485 
Neumann’s problem 479 
Newton’s, interpolation formu- 
la 327 

method of approximation 203 
Newton-Cotes quadrature for- 
mulas 400 
Nodal point 293, 484 
Node 485 

Non invertible matrix 57 
Nonremovable error 15 
Nonsingular matrix 57 
Norm, of a matrix 90 

on the set of net functions 
487 

of a vector 90 

Normal form of a system of li- 
near equations 149 
Normalized form of notation n[ 
a number 20 
Null matrix 42 

Numerical, differentiation 374- 
378 

integration 379-382 


Order, of approximation of a 
boundary- value pro- 
blem 488 

of convergence of a difference 
scheme 490 

of correctness of a table of 
finite differences 315 
of a differential equation 421 
of a number 20 
of a square matrix 41 

Partial sum of a series 34i) 
Particular solution of a differ- 
ential equation 424 
Periodic function 351 
Piecewise-continuous function 
352 

Piecewise-monotonic function 
352 

Pivot, coefficient 124 
element 121 
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row 121 
unknown 124 
Power series 349 
Principal diagonal 41 
Principle, of the maximum 480 
of Runge 455 

Problem, Cauchy's 425, 474 
for hyperbolic equations 477 
for parabolic equations 478 
for an unbonded domain 476 
Dirichlet’s 479 

with initial conditions 425 
without initial conditions 475 
Neumann’s 479 
Product, of a matrix by a num- 
ber 43 

of two matrices 44 

of a vector by a scalar 46 


Quadratic interpolation 297 
Quadrature 379 
formula b7J 
for interpolation 398 
of Newton-Cotes 396 


Rank of a matrix 91 
Rational function 180 
entire 180 
integral 180 

Rational fractional function 181 
Rectangular matrix 40 
Relative error 18 
Hoot, of an equation 179 
of multiplicity s 166 
of a polynomial 166 
Rounding error 15 
Rounding off 16 
Row, matrix 40 
vector 40 

Rule, of annulus 228 
of calculating digits 36-37 
of Descartes 225 
of rounding off 16 
of triangles 49 
Runge's principle 455 


Scheme of unique division 127 
Seidel’s method 156 


Separated root of an equation 
184 

Sequence 347 
constant 347 
convergent 348 
divergent 348 
general term of 347 
Series 349 
convergent 349 
divergent 349 
of Fourier 351 
sum of 349 
Significant digit 17 
valid 20 

Simple root 166 
Singular matrix 57 
Solution, of a differential equa- 
tion 424 

of an equation 179 
of a system of equations 108, 
180 

Square matrix 41 
Space basis 98 

Stability of a difference problem 
489 

Step of iteration 434 
Step matrix 78 
Subdiagonal matrix 66 
Sum, of matrices 42 
of series 349 
of vectors 46 
Superdiagonal matrix 66 
Symmetric matrix 42 
System of equations 108, 114, 
118, 124, 179 


Tabular method of representing 
a function 284 
Theorem, of Bezout 168 
on a base minor 100 
on convergence of a differ- 
ence scheme 490 
of Dirichlet 352 
fundamental, of algebra 224 
of Hamilton-Cayley 245 
of Kronecker-Capelli 110 
on linear dependence of vec- 
tors 96 
of Sturm 228 

Theorems, on continuous 
functions 189 
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on convergence of interpola- 
tion process 215 
on determinants 50-52 
on quadrature formulas 408- 
409 

Trace of a matrix 242 
Transcendental function 181 
Transpose of matrix 46 
Trial and error method 192 
Triangular matrix CG 
lower 66 
upper 66 


Unit, matrix 41 
vector 98 


Unknowns 108 
Unremovable error 15 
Upper triangular matrix 66 


Valid digit, in a product 30 
in a quotient 34 
significant digit 20 
Value of a decimal position 16 
Vector 41 
Vector space 95 


Zero of a polynomial 166 
Zero matrix 42 



